Sep 10 10:34:39.959260 ip-10-0-133-250 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 10:34:40.321357 ip-10-0-133-250 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 10:34:40.321357 ip-10-0-133-250 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 10:34:40.321357 ip-10-0-133-250 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 10:34:40.321357 ip-10-0-133-250 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 10:34:40.321357 ip-10-0-133-250 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 10:34:40.322860 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.322779    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 10:34:40.327084 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327069    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.327084 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327084    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327088    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327091    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327094    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327097    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327100    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327102    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327105    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327108    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327110    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327113    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327116    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327118    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327122    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327125    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327127    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327130    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327134    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327138    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.327153 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327141    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327144    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327147    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327149    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327158    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327160    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327164    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327167    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327170    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327173    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327175    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327178    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327180    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327183    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327186    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327188    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327191    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327193    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327196    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327199    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.327606 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327202    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327205    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327207    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327211    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327213    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327216    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327218    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327221    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327223    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327226    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327228    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327231    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327235    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327238    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327241    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327245    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327248    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327251    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327254    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327257    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.328122 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327260    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327262    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327265    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327268    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327270    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327273    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327275    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327278    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327280    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327283    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327288    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327291    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327294    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327297    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327300    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327304    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327307    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327309    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327312    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327314    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.328626 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327317    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327320    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327323    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327326    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327328    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327331    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327334    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327337    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327340    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327343    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327345    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327348    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327351    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327354    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327356    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327359    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327361    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327364    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.327366    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328084    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.329123 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328092    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328095    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328098    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328100    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328103    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328106    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328109    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328111    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328115    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328117    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328120    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328122    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328125    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328128    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328131    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328133    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328136    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328139    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328143    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.329604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328146    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328148    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328151    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328154    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328157    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328159    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328162    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328165    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328167    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328170    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328172    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328175    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328177    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328180    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328182    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328185    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328188    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328190    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328194    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328196    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.330093 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328199    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328201    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328204    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328207    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328209    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328212    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328215    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328218    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328220    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328223    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328226    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328229    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328232    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328237    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328241    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328245    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328248    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328251    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328254    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328257    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.330584 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328259    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328262    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328264    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328267    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328270    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328273    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328275    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328278    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328280    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328283    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328285    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328288    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328291    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328294    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328297    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328300    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328303    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328305    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328308    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328310    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.331182 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328314    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328316    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328319    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328323    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328325    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328329    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328331    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328334    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328336    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328339    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328341    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328344    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328347    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328349    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328351    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328354    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328358    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328361    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.331681 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328364    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328790    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328796    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328800    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328803    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328812    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328815    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328819    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328822    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328825    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328829    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328832    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328834    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328837    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328840    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328843    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328845    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328848    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328851    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.332144 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328854    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328857    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328861    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328864    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328867    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328870    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328873    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328876    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328879    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328881    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328884    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328886    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328889    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328891    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328894    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328896    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328899    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328901    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328904    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.332630 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328912    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328915    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328917    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328920    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328922    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328925    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328928    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328930    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328933    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328935    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328938    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328942    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328945    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328947    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328950    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328952    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328955    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328958    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328974    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328977    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328980    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.333117 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328982    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328985    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328987    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328990    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328992    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328995    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.328997    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329000    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329002    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329005    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329007    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329010    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329018    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329021    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329023    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329026    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329028    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329032    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329036    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329038    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.333618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329041    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329043    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329047    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329050    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329052    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329055    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329057    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329060    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329063    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329065    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329068    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329070    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329073    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329075    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329078    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329080    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329083    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329085    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329088    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.334147 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329091    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329093    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329182    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329220    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329231    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329236    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329247    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329250    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329254    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329258    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329261    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329266    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329269    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329272    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329276    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329279    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329282    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329285    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329288    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329291    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329298    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329300    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329304    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329307    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 10:34:40.334604 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329310    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329313    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329316    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329319    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329322    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329326    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329328    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329331    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329334    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329337    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329341    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329344    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329347    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329350    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329353    2583 flags.go:64] FLAG: --enable-server="true"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329362    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329368    2583 flags.go:64] FLAG: --event-burst="100"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329372    2583 flags.go:64] FLAG: --event-qps="50"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329374    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329379    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329382    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329386    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329389    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329392    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329395    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 10 10:34:40.335206 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329398    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329401    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329403    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329406    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329409    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329412    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329415    2583 flags.go:64] FLAG: --feature-gates=""
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329419    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329422    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329425    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329428    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329431    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329434    2583 flags.go:64] FLAG: --help="false"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329436    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329440    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329442    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329445    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329449    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329452    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329455    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329457    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329460    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329463    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 10:34:40.335842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329471    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329474    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329477    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329482    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329485    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329488    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329491    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329494    2583 flags.go:64] FLAG: --lock-file=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329497    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329500    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329503    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329509    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329512    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329514    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329517    2583 flags.go:64] FLAG: --logging-format="text"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329520    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329524    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329526    2583 flags.go:64] FLAG: --manifest-url=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329529    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329534    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329537    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329541    2583 flags.go:64] FLAG: --max-pods="110"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329544    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329547    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329550    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 10:34:40.336494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329553    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329556    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329559    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329562    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329568    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329571    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329574    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329577    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329586    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329591    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329594    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329598    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329601    2583 flags.go:64] FLAG: --port="10250"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329604    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329607    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9c5ceb31a8beb73"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329617    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329621    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329624    2583 flags.go:64] FLAG: --register-node="true"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329627    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329630    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329633    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329636    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329639    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329642    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329645    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 10:34:40.337160 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329648    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329651    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329654    2583 flags.go:64] FLAG: --runonce="false"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329657    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329660    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329663    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329666    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329669    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329672    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329675    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329678    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329681    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329684    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329687    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329689    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329692    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329696    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329699    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329707    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329710    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329713    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329719    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329721    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329724    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329727    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 10:34:40.337776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329730    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329733    2583 flags.go:64] FLAG: --v="2"
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329737    2583 flags.go:64] FLAG: --version="false"
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329741    2583 flags.go:64] FLAG: --vmodule=""
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329745    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.329748    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329915    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329920    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329923    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329926    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329929    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329931    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329934    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329937    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329939    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329942    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329944    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329947    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329949    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329952    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329954    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.338411 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329957    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329973    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329976    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329987    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329991    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329993    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.329996    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330000    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330002    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330005    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330008    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330010    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330013    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330015    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330018    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330028    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330030    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330033    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330036    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330038    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.338913 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330041    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330043    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330046    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330049    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330051    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330054    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330056    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330059    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330061    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330064    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330066    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330069    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330072    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330074    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330077    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330079    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330088    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330091    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330094    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.339445 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330099    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330103    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330106    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330109    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330112    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330115    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330117    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330120    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330122    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330125    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330127    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330130    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330133    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330136    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330138    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330141    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330143    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330146    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330148    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330151    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.339910 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330153    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330156    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330158    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330161    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330163    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330165    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330169    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330173    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330175    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330179    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330187    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330190    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330194    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330197    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330199    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330202    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330205    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330207    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330210    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.340484 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330212    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330216    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330220    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330223    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330226    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.330228    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.331490    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.339135    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.339154    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.339174    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.339180    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339257    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339263    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339267    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.340959 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339270    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339273    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339276    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339279    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339282    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339285    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339288    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339291    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339293    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339296    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339298    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339301    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339304    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339306    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339309    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339312    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339314    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339317    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339319    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339322    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.341340 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339324    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339327    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339329    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339332    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339334    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339337    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339346    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339349    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339353    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339357    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339360    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339363    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339366    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339369    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339372    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339374    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339376    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339379    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339381    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.342150 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339384    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339386    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339389    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339391    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339394    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339396    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339399    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339401    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339404    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339406    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339408    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339411    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339414    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339416    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339419    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339421    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339424    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339426    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339429    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339432    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.342618 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339442    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339444    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339447    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339450    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339452    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339455    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339458    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339460    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339463    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339465    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339468    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339470    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339475    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339478    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339481    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339484    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339487    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339490    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339492    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.343163 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339495    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339498    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339503    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339505    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339509    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339512    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339514    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339517    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339519    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339522    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339524    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339527    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339530    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339532    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339540    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339543    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339546    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.343723 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339554    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.339559    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339719    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339724    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339727    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339730    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339733    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339735    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339738    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339741    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339743    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339746    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339748    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339752    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 10:34:40.344180 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339754    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339758    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339761    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339763    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339766    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339769    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339771    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339774    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339776    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339779    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339782    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339784    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339788    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339792    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339795    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339798    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339806    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339809    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339813    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 10:34:40.344533 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339815    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339818    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339821    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339824    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339826    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339829    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339831    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339834    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339836    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339840    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339843    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339846    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339849    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339851    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339854    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339856    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339859    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339861    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339864    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 10:34:40.345033 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339867    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339870    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339872    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339875    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339877    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339880    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339883    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339885    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339888    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339890    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339893    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339906    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339910    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339914    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339917    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339921    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339926    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339929    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339932    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339934    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 10:34:40.345496 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339937    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339939    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339942    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339945    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339947    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339950    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339952    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339955    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339957    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339979    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339983    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339986    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339989    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339991    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339994    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339996    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.339999    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340002    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340005    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340007    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 10:34:40.346008 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340010    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340012    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340015    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340017    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340026    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340029    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340031    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340034    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:40.340036    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.340041    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.340175    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.344719    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.345628    2583 server.go:1019] "Starting client certificate rotation"
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.345721    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 10:34:40.346495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.345780    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 10:34:40.347878 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.347865    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 10:34:40.349011 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.348986    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 10:34:40.357871 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.357857    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 10 10:34:40.361258 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.361242    2583 log.go:25] "Validated CRI v1 image API"
Sep 10 10:34:40.362103 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.362090    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 10:34:40.368039 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.368015    2583 fs.go:135] Filesystem UUIDs: map[07044f0d-70a4-43fc-bec1-99523a8b4b21:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8e1661f8-5188-4432-bbd2-b5e245850ca9:/dev/nvme0n1p3]
Sep 10 10:34:40.368085 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.368039    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 10:34:40.369897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.369879    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 10:34:40.375084 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.374979    2583 manager.go:216] Machine: {Timestamp:2026-09-10 10:34:40.372715141 +0000 UTC m=+0.305612240 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105779 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2876fb33341c9edb6881793b7960b2 SystemUUID:ec2876fb-3334-1c9e-db68-81793b7960b2 BootID:57a848e6-f768-4b35-90bf-2d734026ca07 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:32:4b:17:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:32:4b:17:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:bf:a8:30:80:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 10:34:40.375084 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.375081    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 10:34:40.375208 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.375196    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 10:34:40.378210 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.378188    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 10:34:40.378356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.378212    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 10:34:40.379313 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.379304    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 10:34:40.379344 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.379316    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 10:34:40.379344 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.379323    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 10:34:40.379344 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.379340    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 10:34:40.380118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.380108    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 10:34:40.382865 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.382855    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 10:34:40.383002 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.382992    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 10:34:40.383040 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383024    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 10:34:40.383040 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383037    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 10:34:40.383093 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383071    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 10:34:40.383093 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383085    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 10 10:34:40.383147 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383097    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 10:34:40.383632 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383620    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 10:34:40.383689 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.383649    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 10:34:40.391763 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.391630    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 10:34:40.392162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.392140    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9bw4l"
Sep 10 10:34:40.393974 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.393942    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 10:34:40.394073 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.394001    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 10:34:40.394414 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.394387    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 10:34:40.394455 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.394417    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 10:34:40.396072 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396058    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396077    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396084    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396090    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396098    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396103    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396117    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 10:34:40.396121 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396122    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396130    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396135    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396143    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396149    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396172    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 10:34:40.396314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.396177    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 10:34:40.399901 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.399890    2583 server.go:1268] "Started kubelet"
Sep 10 10:34:40.400021 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.399992    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 10:34:40.400086 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.400023    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9bw4l"
Sep 10 10:34:40.400086 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.400009    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 10:34:40.400176 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.400094    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 10:34:40.400792 ip-10-0-133-250 systemd[1]: Started Kubernetes Kubelet.
Sep 10 10:34:40.401848 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.401121    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 10:34:40.402810 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.402547    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 10:34:40.405398 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.405375    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 10:34:40.407613 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.407596    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 10:34:40.408361 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.408343    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 10:34:40.408453 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.408417    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.409019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.408994    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 10:34:40.409019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409016    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 10:34:40.409126 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.408998    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 10:34:40.409175 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409135    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 10:34:40.409175 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409143    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 10:34:40.409306 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.406605    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-250.ec2.internal.18d3ef334072f00d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-250.ec2.internal,UID:ip-10-0-133-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-250.ec2.internal,},FirstTimestamp:2026-09-10 10:34:40.399863821 +0000 UTC m=+0.332760920,LastTimestamp:2026-09-10 10:34:40.399863821 +0000 UTC m=+0.332760920,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-250.ec2.internal,}"
Sep 10 10:34:40.409459 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409446    2583 factory.go:55] Registering systemd factory
Sep 10 10:34:40.409516 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409462    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 10 10:34:40.409698 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409684    2583 factory.go:153] Registering CRI-O factory
Sep 10 10:34:40.409765 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409702    2583 factory.go:223] Registration of the crio container factory successfully
Sep 10 10:34:40.409765 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409758    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 10:34:40.409861 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409779    2583 factory.go:103] Registering Raw factory
Sep 10 10:34:40.409861 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.409793    2583 manager.go:1196] Started watching for new ooms in manager
Sep 10 10:34:40.410159 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.410145    2583 manager.go:349] Starting recovery of all containers
Sep 10 10:34:40.411986 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.411950    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:40.416102 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.416078    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-250.ec2.internal\" not found" node="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.419950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.419923    2583 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found
Sep 10 10:34:40.421801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.421784    2583 manager.go:354] Recovery completed
Sep 10 10:34:40.427290 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.427277    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.429102 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429083    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.429168 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429121    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.429168 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429135    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.429701 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429689    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 10:34:40.429735 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429701    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 10:34:40.429735 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429705    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.429735 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.429717    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 10:34:40.430600 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430587    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.430658 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430611    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.430658 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430621    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.430866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430855    2583 policy_none.go:49] "None policy: Start"
Sep 10 10:34:40.430904 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430870    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 10:34:40.430904 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.430880    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 10:34:40.431768 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.431758    2583 policy_none.go:47] "Start"
Sep 10 10:34:40.435559 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.435541    2583 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found
Sep 10 10:34:40.454689 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.454675    2583 manager.go:337] "Starting Device Plugin manager"
Sep 10 10:34:40.454786 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.454709    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 10:34:40.454786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.454719    2583 server.go:87] "Starting device plugin registration server"
Sep 10 10:34:40.455049 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.455035    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 10:34:40.455114 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.455054    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 10:34:40.455621 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.455253    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 10:34:40.455716 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.455694    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 10:34:40.455794 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.455740    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 10:34:40.455794 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.455749    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.455794 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.455752    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 10:34:40.494399 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.494380    2583 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found
Sep 10 10:34:40.547032 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.546998    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 10:34:40.548266 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.548250    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 10:34:40.548331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.548298    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 10:34:40.548331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.548324    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 10:34:40.548426 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.548370    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 10:34:40.550828 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.550804    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:40.555698 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.555684    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.556496 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.556481    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.556563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.556519    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.556563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.556535    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.556563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.556561    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.565018 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.565003    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.565084 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.565028    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-250.ec2.internal\": node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.583722 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.583651    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.649358 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.649329    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"]
Sep 10 10:34:40.649466 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.649427    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.653572 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.653549    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.653687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.653585    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.653687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.653599    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.656135 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656118    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.656251 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.656294 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656261    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.656885 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656870    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.656983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656886    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.656983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656899    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.656983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656908    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.656983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656915    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.656983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.656921    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.659117 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.659101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.659195 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.659128    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 10:34:40.660481 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.660466    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 10:34:40.660564 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.660496    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 10:34:40.660564 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.660511    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID"
Sep 10 10:34:40.684258 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.684238    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.689600 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.689584    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-250.ec2.internal\" not found" node="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.693913 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.693900    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-250.ec2.internal\" not found" node="ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.710750 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.710732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.710802 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.710755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.710802 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.710774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.784904 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.784882    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.811248 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.811248 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.811356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.811356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.811356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.811356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.811328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.885635 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.885576    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.986116 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:40.986093    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:40.992262 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.992243    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:40.997301 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:40.996939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:41.086912 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:41.086883    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.552840 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:42.552816    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.653307 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:42.653275    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.710792 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.710768    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 10:34:42.711175 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.710893    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 10:34:42.711175 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.710916    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 10:34:42.754438 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:42.754281    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.771472 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.771419    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 10:29:41 +0000 UTC" deadline="2028-02-15 17:18:49.274861578 +0000 UTC"
Sep 10 10:34:42.771472 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.771447    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12558h44m6.503417222s"
Sep 10 10:34:42.802953 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.802930    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:42.855469 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:42.855435    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.942302 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:42.942275    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab785fdfa0a233510495d26882d5258b.slice/crio-447390b90e67ecb58e9a5acdeb24208f3ac7ee7b6fb6a8c42816bf70ad0127e0 WatchSource:0}: Error finding container 447390b90e67ecb58e9a5acdeb24208f3ac7ee7b6fb6a8c42816bf70ad0127e0: Status 404 returned error can't find the container with id 447390b90e67ecb58e9a5acdeb24208f3ac7ee7b6fb6a8c42816bf70ad0127e0
Sep 10 10:34:42.943801 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:42.943777    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb165d55e894605f0ca2c828f2460a9.slice/crio-ca361ef9569a8a7c48448b6a7995b231cf62840c1db4cf09ee2e50dd11c7b174 WatchSource:0}: Error finding container ca361ef9569a8a7c48448b6a7995b231cf62840c1db4cf09ee2e50dd11c7b174: Status 404 returned error can't find the container with id ca361ef9569a8a7c48448b6a7995b231cf62840c1db4cf09ee2e50dd11c7b174
Sep 10 10:34:42.948077 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.948061    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 10:34:42.956032 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:42.956012    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found"
Sep 10 10:34:42.981761 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:42.981743    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:43.074976 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.074905    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:43.086414 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.086392    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 10:34:43.087259 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.087245    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"
Sep 10 10:34:43.095550 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.095532    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 10:34:43.749672 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.749629    2583 apiserver.go:52] "Watching apiserver"
Sep 10 10:34:43.761614 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.761586    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 10:34:43.763430 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.763397    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wqk2p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal","openshift-multus/network-metrics-daemon-wp72z","openshift-network-operator/iptables-alerter-qgjfr","openshift-ovn-kubernetes/ovnkube-node-cpttd","kube-system/global-pull-secret-syncer-lr2sm","kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz","openshift-multus/multus-additional-cni-plugins-pfwcd","openshift-multus/multus-bzwhf","openshift-network-diagnostics/network-check-target-txgnh","kube-system/konnectivity-agent-pbtrf","openshift-cluster-node-tuning-operator/tuned-5dnr2","openshift-dns/node-resolver-4qs9j"]
Sep 10 10:34:43.766124 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.766106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.768486 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.768223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.768819 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.768649    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 10:34:43.768918 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.768834    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.768918 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.768843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.769141 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.769052    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jxt8p\""
Sep 10 10:34:43.770401 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.770343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.771493 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.771477    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.771675 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.771661    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vtxft\""
Sep 10 10:34:43.771816 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.771804    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.772474 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.772419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.772576 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.772496    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r7mlz\""
Sep 10 10:34:43.772686 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.772670    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.772748 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.772724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.773796 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.773640    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 10:34:43.774854 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.774836    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 10:34:43.775215 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.775193    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.775310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.775226    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.775310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.775252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vn5vc\""
Sep 10 10:34:43.777218 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.777199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.779826 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.779726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.779826 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.779782    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.779961 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.779899    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 10:34:43.780168 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.780150    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 10:34:43.780265 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.780222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.781073 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.781000    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ttcw4\""
Sep 10 10:34:43.781073 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.781022    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 10:34:43.781214 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.781110    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 10:34:43.782019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.782002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.782562 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.782542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 10:34:43.782671 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.782621    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 10:34:43.782731 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.782676    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ttczd\""
Sep 10 10:34:43.784212 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.784194    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 10:34:43.784407 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.784393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.785010 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.784973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tlxlw\""
Sep 10 10:34:43.785100 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785036    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.785182 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785162    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.785413 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-tuned\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785508 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-tmp\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785508 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-slash\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785508 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-systemd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785508 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-config\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785703 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-systemd\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785703 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-sys\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785703 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-var-lib-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-log-socket\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-netd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovn-node-metrics-cert\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-script-lib\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-sys-fs\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-kubernetes\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-run\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-lib-modules\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-netns\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.785995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.785973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-ovn\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-env-overrides\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-device-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-socket-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc14834-1f7a-4d8d-8a76-666d384f4857-hosts-file\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.786203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-kubelet\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-node-log\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr9v8\" (UniqueName: \"kubernetes.io/projected/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-kube-api-access-kr9v8\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-registration-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc14834-1f7a-4d8d-8a76-666d384f4857-tmp-dir\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-host\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvl88\" (UniqueName: \"kubernetes.io/projected/0fad096d-70d3-4c30-91c4-68ec759cdf56-kube-api-access-jvl88\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568336b8-6cda-4eeb-848e-038b5cc0b826-host-slash\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-bin\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.786591 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysconfig\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568336b8-6cda-4eeb-848e-038b5cc0b826-iptables-alerter-script\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-systemd-units\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-etc-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jwr\" (UniqueName: \"kubernetes.io/projected/22ba404a-7477-47fe-a378-49ebb2f0c619-kube-api-access-55jwr\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtcx\" (UniqueName: \"kubernetes.io/projected/4dc14834-1f7a-4d8d-8a76-666d384f4857-kube-api-access-hbtcx\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-conf\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-var-lib-kubelet\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dglg7\" (UniqueName: \"kubernetes.io/projected/568336b8-6cda-4eeb-848e-038b5cc0b826-kube-api-access-dglg7\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.787153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.786859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-modprobe-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.787704 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.787170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.787860 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.787824    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 10:34:43.789151 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.788427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 10:34:43.789151 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.788664    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pbpl7\""
Sep 10 10:34:43.789151 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.788841    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 10:34:43.789151 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.789079    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 10:34:43.790396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.789563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:43.790396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.789619    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 10:34:43.790396 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.789874    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:43.790396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.789974    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 10:34:43.790396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.790002    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 10:34:43.790697 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.790680    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdsd6\""
Sep 10 10:34:43.794639 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.794622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.794761 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.794744    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:43.797841 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.797815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:43.797930 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.797874    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:43.808320 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.808303    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gx7l5"
Sep 10 10:34:43.815942 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.815924    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gx7l5"
Sep 10 10:34:43.875510 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.875488    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 10:34:43.888037 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-socket-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.888171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-system-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-etc-kubernetes\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-socket-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-node-log\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr9v8\" (UniqueName: \"kubernetes.io/projected/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-kube-api-access-kr9v8\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-node-log\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-hostroot\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-conf-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/156d5bf9-fbbf-4bed-842d-cbd047424433-serviceca\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.888448 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-host\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-bin\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-etc-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888590    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-host\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtcx\" (UniqueName: \"kubernetes.io/projected/4dc14834-1f7a-4d8d-8a76-666d384f4857-kube-api-access-hbtcx\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-bin\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-etc-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-k8s-cni-cncf-io\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-multus-certs\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-var-lib-kubelet\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-bin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-modprobe-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-tuned\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.888881 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-var-lib-kubelet\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc14834-1f7a-4d8d-8a76-666d384f4857-hosts-file\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc14834-1f7a-4d8d-8a76-666d384f4857-hosts-file\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-netd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-script-lib\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-multus\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888943    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-modprobe-d\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-cni-netd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.888974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-lib-modules\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-netns\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-ovn\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-env-overrides\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-kubelet\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-run-netns\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-lib-modules\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-daemon-config\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889162    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 10:34:43.889563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-ovn\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpd9b\" (UniqueName: \"kubernetes.io/projected/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-kube-api-access-tpd9b\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-cni-binary-copy\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-kubelet-config\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-dbus\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/156d5bf9-fbbf-4bed-842d-cbd047424433-host\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxz6\" (UniqueName: \"kubernetes.io/projected/f059301e-f05c-462f-9a6c-85ced79f641a-kube-api-access-8cxz6\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32124561-b8d1-42d5-90c6-d8883c93a263-agent-certs\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-kubelet\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-registration-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889558    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-script-lib\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-registration-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.890359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-env-overrides\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-kubelet\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc14834-1f7a-4d8d-8a76-666d384f4857-tmp-dir\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-socket-dir-parent\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32124561-b8d1-42d5-90c6-d8883c93a263-konnectivity-ca\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvl88\" (UniqueName: \"kubernetes.io/projected/0fad096d-70d3-4c30-91c4-68ec759cdf56-kube-api-access-jvl88\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568336b8-6cda-4eeb-848e-038b5cc0b826-host-slash\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-system-cni-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysconfig\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568336b8-6cda-4eeb-848e-038b5cc0b826-iptables-alerter-script\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-systemd-units\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/568336b8-6cda-4eeb-848e-038b5cc0b826-host-slash\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jwr\" (UniqueName: \"kubernetes.io/projected/22ba404a-7477-47fe-a378-49ebb2f0c619-kube-api-access-55jwr\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc14834-1f7a-4d8d-8a76-666d384f4857-tmp-dir\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.891112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-systemd-units\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tcfd\" (UniqueName: \"kubernetes.io/projected/156d5bf9-fbbf-4bed-842d-cbd047424433-kube-api-access-6tcfd\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889975    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysconfig\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.889987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-conf\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dglg7\" (UniqueName: \"kubernetes.io/projected/568336b8-6cda-4eeb-848e-038b5cc0b826-kube-api-access-dglg7\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-cnibin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-netns\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-tmp\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-sysctl-conf\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-slash\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-host-slash\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-systemd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890183    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-config\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-run-systemd\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovn-node-metrics-cert\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovnkube-config\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/568336b8-6cda-4eeb-848e-038b5cc0b826-iptables-alerter-script\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.891845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-sys-fs\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-systemd\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890963    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-sys-fs\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.890969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-sys\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-systemd\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-var-lib-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-log-socket\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhlmp\" (UniqueName: \"kubernetes.io/projected/2c5c1c85-1eaf-4415-b9bd-98319999c939-kube-api-access-bhlmp\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-sys\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-log-socket\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-var-lib-openvswitch\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-kubernetes\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-run\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-device-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891213    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891272    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-device-dir\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-run\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.892374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cnibin\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.892995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/22ba404a-7477-47fe-a378-49ebb2f0c619-etc-selinux\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.892995 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.891408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-kubernetes\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.893636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.893608    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-etc-tuned\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.893756 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.893611    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-ovn-node-metrics-cert\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.893756 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.893654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fad096d-70d3-4c30-91c4-68ec759cdf56-tmp\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.897147 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.897120    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtcx\" (UniqueName: \"kubernetes.io/projected/4dc14834-1f7a-4d8d-8a76-666d384f4857-kube-api-access-hbtcx\") pod \"node-resolver-4qs9j\" (UID: \"4dc14834-1f7a-4d8d-8a76-666d384f4857\") " pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:43.898256 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.898225    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dglg7\" (UniqueName: \"kubernetes.io/projected/568336b8-6cda-4eeb-848e-038b5cc0b826-kube-api-access-dglg7\") pod \"iptables-alerter-qgjfr\" (UID: \"568336b8-6cda-4eeb-848e-038b5cc0b826\") " pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:43.898549 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.898528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvl88\" (UniqueName: \"kubernetes.io/projected/0fad096d-70d3-4c30-91c4-68ec759cdf56-kube-api-access-jvl88\") pod \"tuned-5dnr2\" (UID: \"0fad096d-70d3-4c30-91c4-68ec759cdf56\") " pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:43.898622 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.898527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr9v8\" (UniqueName: \"kubernetes.io/projected/1ac419bf-6e1c-482a-82dd-e6eb69c9ab44-kube-api-access-kr9v8\") pod \"ovnkube-node-cpttd\" (UID: \"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:43.898857 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.898841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jwr\" (UniqueName: \"kubernetes.io/projected/22ba404a-7477-47fe-a378-49ebb2f0c619-kube-api-access-55jwr\") pod \"aws-ebs-csi-driver-node-2mvzz\" (UID: \"22ba404a-7477-47fe-a378-49ebb2f0c619\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:43.918300 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.918254    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerStarted","Data":"447390b90e67ecb58e9a5acdeb24208f3ac7ee7b6fb6a8c42816bf70ad0127e0"}
Sep 10 10:34:43.919483 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.919459    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" event={"ID":"ccb165d55e894605f0ca2c828f2460a9","Type":"ContainerStarted","Data":"ca361ef9569a8a7c48448b6a7995b231cf62840c1db4cf09ee2e50dd11c7b174"}
Sep 10 10:34:43.992185 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tcfd\" (UniqueName: \"kubernetes.io/projected/156d5bf9-fbbf-4bed-842d-cbd047424433-kube-api-access-6tcfd\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.992185 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-cnibin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992209    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-netns\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhlmp\" (UniqueName: \"kubernetes.io/projected/2c5c1c85-1eaf-4415-b9bd-98319999c939-kube-api-access-bhlmp\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cnibin\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-system-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-cnibin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-etc-kubernetes\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-netns\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-hostroot\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992393    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cnibin\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992420    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-etc-kubernetes\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-system-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-conf-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.992472    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-hostroot\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/156d5bf9-fbbf-4bed-842d-cbd047424433-serviceca\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992476    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-conf-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.992559    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:34:44.49252017 +0000 UTC m=+3.060000763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-k8s-cni-cncf-io\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-multus-certs\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-bin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-multus\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.992849 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-kubelet\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-daemon-config\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/156d5bf9-fbbf-4bed-842d-cbd047424433-serviceca\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992881    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpd9b\" (UniqueName: \"kubernetes.io/projected/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-kube-api-access-tpd9b\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-cni-binary-copy\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-kubelet-config\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.992977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-dbus\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993022    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/156d5bf9-fbbf-4bed-842d-cbd047424433-host\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993049    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-k8s-cni-cncf-io\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-run-multus-certs\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-multus\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-cni-bin\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/156d5bf9-fbbf-4bed-842d-cbd047424433-host\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:43.993328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxz6\" (UniqueName: \"kubernetes.io/projected/f059301e-f05c-462f-9a6c-85ced79f641a-kube-api-access-8cxz6\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32124561-b8d1-42d5-90c6-d8883c93a263-agent-certs\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-socket-dir-parent\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32124561-b8d1-42d5-90c6-d8883c93a263-konnectivity-ca\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-system-cni-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993227    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-system-cni-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-kubelet-config\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-host-var-lib-kubelet\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-cni-dir\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-socket-dir-parent\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e1723f71-9ccf-43ab-9ed4-40b79714af8d-dbus\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.993471    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:43.993531    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:34:44.493512511 +0000 UTC m=+3.060993111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993738    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-cni-binary-copy\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.994008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.993856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32124561-b8d1-42d5-90c6-d8883c93a263-konnectivity-ca\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:43.995283 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.995260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5c1c85-1eaf-4415-b9bd-98319999c939-multus-daemon-config\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:43.995994 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:43.995974    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32124561-b8d1-42d5-90c6-d8883c93a263-agent-certs\") pod \"konnectivity-agent-pbtrf\" (UID: \"32124561-b8d1-42d5-90c6-d8883c93a263\") " pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:44.001134 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.001083    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhlmp\" (UniqueName: \"kubernetes.io/projected/2c5c1c85-1eaf-4415-b9bd-98319999c939-kube-api-access-bhlmp\") pod \"multus-bzwhf\" (UID: \"2c5c1c85-1eaf-4415-b9bd-98319999c939\") " pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:44.006146 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.006126    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:44.006146 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.006147    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:44.006309 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.006156    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:44.006309 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.006218    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:34:44.506204987 +0000 UTC m=+3.073685599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:44.008298 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.008277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpd9b\" (UniqueName: \"kubernetes.io/projected/4439fa18-fa8d-42a7-a0fa-734a4ee2e202-kube-api-access-tpd9b\") pod \"multus-additional-cni-plugins-pfwcd\" (UID: \"4439fa18-fa8d-42a7-a0fa-734a4ee2e202\") " pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:44.008595 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.008575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tcfd\" (UniqueName: \"kubernetes.io/projected/156d5bf9-fbbf-4bed-842d-cbd047424433-kube-api-access-6tcfd\") pod \"node-ca-wqk2p\" (UID: \"156d5bf9-fbbf-4bed-842d-cbd047424433\") " pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:44.008676 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.008578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxz6\" (UniqueName: \"kubernetes.io/projected/f059301e-f05c-462f-9a6c-85ced79f641a-kube-api-access-8cxz6\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:44.079209 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.079178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz"
Sep 10 10:34:44.087951 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.087928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qs9j"
Sep 10 10:34:44.095194 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.095171    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:44.099446 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.099420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dnr2"
Sep 10 10:34:44.107020 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.106999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qgjfr"
Sep 10 10:34:44.112753 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.112734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:34:44.118641 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.118622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:34:44.125237 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.125217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqk2p"
Sep 10 10:34:44.131924 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.131910    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzwhf"
Sep 10 10:34:44.136808 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.136791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfwcd"
Sep 10 10:34:44.200245 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.200216    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 10:34:44.497367 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.497333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:44.497571 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.497425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:44.497571 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.497521    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:44.497571 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.497548    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:44.497718 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.497592    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:34:45.49757371 +0000 UTC m=+4.065054321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:44.497718 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.497636    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:34:45.497601964 +0000 UTC m=+4.065082559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:44.598349 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.598307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:44.598516 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.598478    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:44.598516 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.598500    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:44.598516 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.598509    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:44.598644 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.598563    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:34:45.598549821 +0000 UTC m=+4.166030420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:44.754364 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.754334    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32124561_b8d1_42d5_90c6_d8883c93a263.slice/crio-90dcfbba40535434516f050e3ebeb9555c1af518783c13d4074a1d8993d14923 WatchSource:0}: Error finding container 90dcfbba40535434516f050e3ebeb9555c1af518783c13d4074a1d8993d14923: Status 404 returned error can't find the container with id 90dcfbba40535434516f050e3ebeb9555c1af518783c13d4074a1d8993d14923
Sep 10 10:34:44.755718 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.755638    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5c1c85_1eaf_4415_b9bd_98319999c939.slice/crio-4b5d5809b76622b12fd192b20784d4e7f81593d685a6ecbe2365e0ab607a3023 WatchSource:0}: Error finding container 4b5d5809b76622b12fd192b20784d4e7f81593d685a6ecbe2365e0ab607a3023: Status 404 returned error can't find the container with id 4b5d5809b76622b12fd192b20784d4e7f81593d685a6ecbe2365e0ab607a3023
Sep 10 10:34:44.758374 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.758353    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568336b8_6cda_4eeb_848e_038b5cc0b826.slice/crio-0e18b5ba7e90c42c299e4f1e7e6de9845bee4a7adb6e36def7f3ee5c75ca1d12 WatchSource:0}: Error finding container 0e18b5ba7e90c42c299e4f1e7e6de9845bee4a7adb6e36def7f3ee5c75ca1d12: Status 404 returned error can't find the container with id 0e18b5ba7e90c42c299e4f1e7e6de9845bee4a7adb6e36def7f3ee5c75ca1d12
Sep 10 10:34:44.759285 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.759174    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fad096d_70d3_4c30_91c4_68ec759cdf56.slice/crio-a55894e2348179b8dcc7f49c1a5f60adbd2c82918d383ff168591a47b57d48e5 WatchSource:0}: Error finding container a55894e2348179b8dcc7f49c1a5f60adbd2c82918d383ff168591a47b57d48e5: Status 404 returned error can't find the container with id a55894e2348179b8dcc7f49c1a5f60adbd2c82918d383ff168591a47b57d48e5
Sep 10 10:34:44.761257 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.761233    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac419bf_6e1c_482a_82dd_e6eb69c9ab44.slice/crio-ba431f6d9292f2835ad5c8627b914f31ef515bde9db58e6609a06febbcc5e3ca WatchSource:0}: Error finding container ba431f6d9292f2835ad5c8627b914f31ef515bde9db58e6609a06febbcc5e3ca: Status 404 returned error can't find the container with id ba431f6d9292f2835ad5c8627b914f31ef515bde9db58e6609a06febbcc5e3ca
Sep 10 10:34:44.762269 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.762244    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4439fa18_fa8d_42a7_a0fa_734a4ee2e202.slice/crio-ee699a4117ebd88e50c564d5596982d4a0bf21ae9baa4e9a86fea5166bb7365e WatchSource:0}: Error finding container ee699a4117ebd88e50c564d5596982d4a0bf21ae9baa4e9a86fea5166bb7365e: Status 404 returned error can't find the container with id ee699a4117ebd88e50c564d5596982d4a0bf21ae9baa4e9a86fea5166bb7365e
Sep 10 10:34:44.762719 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.762694    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ba404a_7477_47fe_a378_49ebb2f0c619.slice/crio-dd16c6a8db777bfff4cd4885d1c5474729359b6d8d273c6d40e61a61c8624e43 WatchSource:0}: Error finding container dd16c6a8db777bfff4cd4885d1c5474729359b6d8d273c6d40e61a61c8624e43: Status 404 returned error can't find the container with id dd16c6a8db777bfff4cd4885d1c5474729359b6d8d273c6d40e61a61c8624e43
Sep 10 10:34:44.764607 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.764414    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156d5bf9_fbbf_4bed_842d_cbd047424433.slice/crio-52f9778ff2e27690aca2c907dae581e7d0ac1947fe8ca65325b343aaf6d60e5c WatchSource:0}: Error finding container 52f9778ff2e27690aca2c907dae581e7d0ac1947fe8ca65325b343aaf6d60e5c: Status 404 returned error can't find the container with id 52f9778ff2e27690aca2c907dae581e7d0ac1947fe8ca65325b343aaf6d60e5c
Sep 10 10:34:44.766351 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:34:44.766323    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc14834_1f7a_4d8d_8a76_666d384f4857.slice/crio-c9c5d6b749a708eca7217d94cf815660ba1821f3fa9111e2b24b62b04d26989f WatchSource:0}: Error finding container c9c5d6b749a708eca7217d94cf815660ba1821f3fa9111e2b24b62b04d26989f: Status 404 returned error can't find the container with id c9c5d6b749a708eca7217d94cf815660ba1821f3fa9111e2b24b62b04d26989f
Sep 10 10:34:44.819213 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.819181    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 10:29:43 +0000 UTC" deadline="2028-05-14 05:01:34.491589656 +0000 UTC"
Sep 10 10:34:44.819213 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.819214    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14682h26m49.672380312s"
Sep 10 10:34:44.914332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.914304    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:44.914332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.914336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:44.914529 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.914431    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:44.914580 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:44.914554    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:44.922891 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.922860    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqk2p" event={"ID":"156d5bf9-fbbf-4bed-842d-cbd047424433","Type":"ContainerStarted","Data":"52f9778ff2e27690aca2c907dae581e7d0ac1947fe8ca65325b343aaf6d60e5c"}
Sep 10 10:34:44.926053 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.925758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"ba431f6d9292f2835ad5c8627b914f31ef515bde9db58e6609a06febbcc5e3ca"}
Sep 10 10:34:44.927520 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.927477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qgjfr" event={"ID":"568336b8-6cda-4eeb-848e-038b5cc0b826","Type":"ContainerStarted","Data":"0e18b5ba7e90c42c299e4f1e7e6de9845bee4a7adb6e36def7f3ee5c75ca1d12"}
Sep 10 10:34:44.928645 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.928618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzwhf" event={"ID":"2c5c1c85-1eaf-4415-b9bd-98319999c939","Type":"ContainerStarted","Data":"4b5d5809b76622b12fd192b20784d4e7f81593d685a6ecbe2365e0ab607a3023"}
Sep 10 10:34:44.929793 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.929774    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pbtrf" event={"ID":"32124561-b8d1-42d5-90c6-d8883c93a263","Type":"ContainerStarted","Data":"90dcfbba40535434516f050e3ebeb9555c1af518783c13d4074a1d8993d14923"}
Sep 10 10:34:44.932196 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.932166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" event={"ID":"ccb165d55e894605f0ca2c828f2460a9","Type":"ContainerStarted","Data":"e8368a4aae197f5e19a5018a3db3569cba985fbdb4aad8ca0c31f16f74fed904"}
Sep 10 10:34:44.940776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.940755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qs9j" event={"ID":"4dc14834-1f7a-4d8d-8a76-666d384f4857","Type":"ContainerStarted","Data":"c9c5d6b749a708eca7217d94cf815660ba1821f3fa9111e2b24b62b04d26989f"}
Sep 10 10:34:44.942841 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.942813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz" event={"ID":"22ba404a-7477-47fe-a378-49ebb2f0c619","Type":"ContainerStarted","Data":"dd16c6a8db777bfff4cd4885d1c5474729359b6d8d273c6d40e61a61c8624e43"}
Sep 10 10:34:44.943901 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.943883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerStarted","Data":"ee699a4117ebd88e50c564d5596982d4a0bf21ae9baa4e9a86fea5166bb7365e"}
Sep 10 10:34:44.946210 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.946187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dnr2" event={"ID":"0fad096d-70d3-4c30-91c4-68ec759cdf56","Type":"ContainerStarted","Data":"a55894e2348179b8dcc7f49c1a5f60adbd2c82918d383ff168591a47b57d48e5"}
Sep 10 10:34:44.947704 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:44.947658    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" podStartSLOduration=1.9476418930000001 podStartE2EDuration="1.947641893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:44.94719838 +0000 UTC m=+3.514679025" watchObservedRunningTime="2026-09-10 10:34:44.947641893 +0000 UTC m=+3.515122510"
Sep 10 10:34:45.504188 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.504142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:45.504405 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.504233    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:45.504405 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.504390    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:45.504528 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.504461    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.504441096 +0000 UTC m=+6.071921703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:45.504922 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.504874    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:45.505026 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.504928    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.504912001 +0000 UTC m=+6.072392601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:45.604736 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.604688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:45.604919 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.604887    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:45.604919 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.604913    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:45.605033 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.604927    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:45.605033 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.604996    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.604969059 +0000 UTC m=+6.172449667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:45.819904 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.819774    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 10:29:43 +0000 UTC" deadline="2028-02-22 19:45:33.30194757 +0000 UTC"
Sep 10 10:34:45.819904 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.819833    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12729h10m47.482118334s"
Sep 10 10:34:45.914982 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.914498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:45.914982 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:45.914620    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:45.978375 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.978337    2583 generic.go:356] "Generic (PLEG): container finished" podID="ab785fdfa0a233510495d26882d5258b" containerID="c43a93162c83061aa354a79b7887e09ec682a2031c2cce565b97c6e403405e71" exitCode=0
Sep 10 10:34:45.979314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:45.979287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerDied","Data":"c43a93162c83061aa354a79b7887e09ec682a2031c2cce565b97c6e403405e71"}
Sep 10 10:34:46.915272 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:46.914371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:46.915272 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:46.914506    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:46.915272 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:46.914855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:46.915272 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:46.914966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:47.014750 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:47.014708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerStarted","Data":"261048855fc5bc134db5116bcc419c5ed8a31842f44c40d3726af83b4665a246"}
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:47.521785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:47.521895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.522033    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.522096    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:34:51.52207848 +0000 UTC m=+10.089559089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.522447    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:47.522625 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.522495    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:34:51.522479829 +0000 UTC m=+10.089960428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:47.622438 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:47.622400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:47.622653 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.622629    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:47.622726 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.622655    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:47.622726 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.622668    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:47.622827 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.622727    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:34:51.622708045 +0000 UTC m=+10.190188645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:47.914190 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:47.914091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:47.914357 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:47.914231    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:48.914788 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:48.914754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:48.915239 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:48.914902    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:48.915323 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:48.915293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:48.915512 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:48.915433    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:49.915072 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:49.914609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:49.915072 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:49.914736    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:50.914487 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:50.914085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:50.914487 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:50.914133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:50.914487 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:50.914243    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:50.914487 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:50.914369    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:51.559338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:51.559433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.559580    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.559636    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:34:59.559619428 +0000 UTC m=+18.127100029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.559826    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:51.559956 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.559894    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:34:59.559874343 +0000 UTC m=+18.127354968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:51.660647 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:51.660071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:51.660647 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.660221    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:51.660647 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.660238    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:51.660647 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.660248    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:51.660647 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.660302    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:34:59.660285658 +0000 UTC m=+18.227766456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:51.915941 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:51.915863    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:51.916090 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:51.915978    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:52.914484 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:52.914395    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:52.914484 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:52.914446    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:52.915021 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:52.914532    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:52.915021 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:52.914686    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:53.914643 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:53.914610    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:53.915072 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:53.914749    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:54.914270 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:54.914242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:54.914444 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:54.914271    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:54.914444 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:54.914391    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:54.914561 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:54.914529    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:55.914424 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:55.914388    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:55.914860 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:55.914514    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:56.914488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:56.914457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:56.914934 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:56.914571    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:56.914934 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:56.914619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:56.914934 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:56.914743    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:57.914363 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:57.914313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:57.914557 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:57.914479    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:34:58.914398 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:58.914358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:58.914616 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:58.914358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:58.914616 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:58.914508    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:34:58.914616 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:58.914554    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:34:59.618706 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:59.618666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:34:59.618899 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:59.618742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:34:59.618899 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.618813    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:59.618899 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.618840    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:59.618899 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.618889    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.618866995 +0000 UTC m=+34.186347593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:34:59.619114 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.618911    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.618901084 +0000 UTC m=+34.186381678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:34:59.719796 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:59.719756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:59.719968 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.719947    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:34:59.720011 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.719974    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:34:59.720011 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.719983    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:59.720115 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.720050    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.72003104 +0000 UTC m=+34.287511633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:34:59.914850 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:34:59.914767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:34:59.915276 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:34:59.914914    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:00.914125 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:00.914086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:00.914310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:00.914098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:00.914310 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:00.914228    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:00.914440 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:00.914305    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:01.914861 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:01.914826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:01.915296 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:01.914937    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:02.914300 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:02.914141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:02.914413 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:02.914370    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:02.914413 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:02.914195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:02.914535 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:02.914467    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:03.048139 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.048105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqk2p" event={"ID":"156d5bf9-fbbf-4bed-842d-cbd047424433","Type":"ContainerStarted","Data":"acf90af1544fc0b58c8186f3ecb624e7137758b48c684562b8ad4f782d00141c"}
Sep 10 10:35:03.051039 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051016    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:35:03.051435 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051416    2583 generic.go:356] "Generic (PLEG): container finished" podID="1ac419bf-6e1c-482a-82dd-e6eb69c9ab44" containerID="5d6ef7395ac02dbe5c552347c901c09c56245e4742f73e56053e5b5d08a987fc" exitCode=1
Sep 10 10:35:03.051524 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"8ed47e5f68c659f5f02e1aba8a835390d14edd4333744cfe7100ac285200d4cc"}
Sep 10 10:35:03.051578 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"3e41142a983fe1c3e005f03e5d8d1643a729dd4a99967e6f8e1a17daf8a8b6ed"}
Sep 10 10:35:03.051626 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"8fbf70478de2eb30f6a71facaf5e063ee3511d930413c98c57970bfe94233cb4"}
Sep 10 10:35:03.051685 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"feb4ba51b3e4f6afaab07348d8fcfa4f38ea4c81a70e6ad87d7b1e13e32e2537"}
Sep 10 10:35:03.051747 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerDied","Data":"5d6ef7395ac02dbe5c552347c901c09c56245e4742f73e56053e5b5d08a987fc"}
Sep 10 10:35:03.052007 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.051787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"10aea9b2275769ae192fbd3b9fefa05255aa4ed39c07772501dc326ac718fa37"}
Sep 10 10:35:03.053167 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.053143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzwhf" event={"ID":"2c5c1c85-1eaf-4415-b9bd-98319999c939","Type":"ContainerStarted","Data":"6baf2c2bfc1e663ee1966fdb1aae117929c33d29bc2c91f0f7e17fbeb66ac469"}
Sep 10 10:35:03.054644 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.054611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pbtrf" event={"ID":"32124561-b8d1-42d5-90c6-d8883c93a263","Type":"ContainerStarted","Data":"e9463999274d07c993661144eff1553cd839e18c28a7cf0c712c06feb17d2f86"}
Sep 10 10:35:03.056147 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.056127    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qs9j" event={"ID":"4dc14834-1f7a-4d8d-8a76-666d384f4857","Type":"ContainerStarted","Data":"0b0a8a4f40f09b49d192a6f1750c52cd9dd5c97ff6a4bdbab17cda1cb280a85f"}
Sep 10 10:35:03.057626 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.057610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz" event={"ID":"22ba404a-7477-47fe-a378-49ebb2f0c619","Type":"ContainerStarted","Data":"1c78eaa2a4d454c7f34296d1ea90c88e410f433f139cdbef4c391173fd96d433"}
Sep 10 10:35:03.059091 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.059072    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="80444d27b47b34d8b72f59c9a516145a1b65358f843ac84651a769b508a1bbfa" exitCode=0
Sep 10 10:35:03.059180 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.059121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"80444d27b47b34d8b72f59c9a516145a1b65358f843ac84651a769b508a1bbfa"}
Sep 10 10:35:03.060711 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.060556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dnr2" event={"ID":"0fad096d-70d3-4c30-91c4-68ec759cdf56","Type":"ContainerStarted","Data":"b329d426485e438b0b02075df2b1d38eee5f80d8208c4c54ce1460a666ca1c84"}
Sep 10 10:35:03.063170 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.063090    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" podStartSLOduration=20.063059892 podStartE2EDuration="20.063059892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:47.060589418 +0000 UTC m=+5.628070052" watchObservedRunningTime="2026-09-10 10:35:03.063059892 +0000 UTC m=+21.630540486"
Sep 10 10:35:03.063917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.063883    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wqk2p" podStartSLOduration=4.459403217 podStartE2EDuration="22.063872235s" totalImagesPullingTime="17.604469018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.063375794 +0000 UTC m=+21.630856434" watchObservedRunningTime="2026-09-10 10:35:03.063872235 +0000 UTC m=+21.631352851"
Sep 10 10:35:03.080155 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.080115    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bzwhf" podStartSLOduration=3.2208706559999998 podStartE2EDuration="21.080104179s" totalImagesPullingTime="17.859233523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.079997176 +0000 UTC m=+21.647477793" watchObservedRunningTime="2026-09-10 10:35:03.080104179 +0000 UTC m=+21.647584794"
Sep 10 10:35:03.094887 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.094849    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qs9j" podStartSLOduration=4.491211593 podStartE2EDuration="22.094838067s" totalImagesPullingTime="17.603626474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.094619773 +0000 UTC m=+21.662100421" watchObservedRunningTime="2026-09-10 10:35:03.094838067 +0000 UTC m=+21.662318679"
Sep 10 10:35:03.111588 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.111551    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5dnr2" podStartSLOduration=4.482648373 podStartE2EDuration="22.111537991s" totalImagesPullingTime="17.628889618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.110970132 +0000 UTC m=+21.678450767" watchObservedRunningTime="2026-09-10 10:35:03.111537991 +0000 UTC m=+21.679018606"
Sep 10 10:35:03.125865 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.125824    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pbtrf" podStartSLOduration=12.030551133 podStartE2EDuration="22.125813559s" totalImagesPullingTime="10.095262426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.12581099 +0000 UTC m=+21.693291632" watchObservedRunningTime="2026-09-10 10:35:03.125813559 +0000 UTC m=+21.693294175"
Sep 10 10:35:03.461457 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.461420    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:35:03.462179 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.462158    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:35:03.915048 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:03.915020    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:03.915234 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:03.915128    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:04.065203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.065110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qgjfr" event={"ID":"568336b8-6cda-4eeb-848e-038b5cc0b826","Type":"ContainerStarted","Data":"ee2cd7a2eaa2126c87a284bed0df49fea6c5aee7ba86b4c9fa5c19a7b97db774"}
Sep 10 10:35:04.084341 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.084294    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qgjfr" podStartSLOduration=5.472965999 podStartE2EDuration="23.084273385s" totalImagesPullingTime="17.611307386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:04.083903688 +0000 UTC m=+22.651384331" watchObservedRunningTime="2026-09-10 10:35:04.084273385 +0000 UTC m=+22.651754005"
Sep 10 10:35:04.252563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.252521    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 10:35:04.833075 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.832933    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T10:35:04.252544299Z","UUID":"d9d0fcde-ae28-4a6a-9e9c-4e9b927dc16b","Handler":null,"Name":"","Endpoint":""}
Sep 10 10:35:04.835282 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.835258    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 10:35:04.835438 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.835295    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 10:35:04.914596 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.914566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:04.914780 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:04.914573    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:04.914780 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:04.914719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:04.914915 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:04.914880    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:05.069802 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:05.069759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz" event={"ID":"22ba404a-7477-47fe-a378-49ebb2f0c619","Type":"ContainerStarted","Data":"51f1fa520124f33b1bde7dd356c229a92cb463ec349ade5f45cd0703966e82ff"}
Sep 10 10:35:05.069802 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:05.069796    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 10:35:05.914796 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:05.914757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:05.914991 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:05.914904    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:06.074619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.074579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz" event={"ID":"22ba404a-7477-47fe-a378-49ebb2f0c619","Type":"ContainerStarted","Data":"8280297281d0a42df99800166b7e2c8b119c00f71984b47866413f32d9994091"}
Sep 10 10:35:06.078556 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.078527    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:35:06.079041 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.079015    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"a989f9deed7a07594ccb7c3e924baea0ad3598a3fb42fd30079d7b9950abec0e"}
Sep 10 10:35:06.093568 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.093523    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2mvzz" podStartSLOduration=5.012092822 podStartE2EDuration="25.093508934s" totalImagesPullingTime="20.081416112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:06.092922303 +0000 UTC m=+24.660402947" watchObservedRunningTime="2026-09-10 10:35:06.093508934 +0000 UTC m=+24.660989555"
Sep 10 10:35:06.914459 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.914250    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:06.914643 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:06.914287    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:06.914643 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:06.914584    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:06.914758 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:06.914652    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:07.914873 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:07.914603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:07.915656 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:07.914928    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:08.084769 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.084730    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="f823fa9304550790604f9b469e854ff42ab577cbc961e5dd34a5647326778838" exitCode=0
Sep 10 10:35:08.084958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.084791    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"f823fa9304550790604f9b469e854ff42ab577cbc961e5dd34a5647326778838"}
Sep 10 10:35:08.088295 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.088278    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:35:08.088651 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.088630    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"ee64f20be19f12b592b7352bfca60e65cb2b1eb41dd864bf6d4aa5a003e6bc1e"}
Sep 10 10:35:08.088815 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.088803    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:08.088874 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.088839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:08.089088 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.089073    2583 scope.go:117] "RemoveContainer" containerID="5d6ef7395ac02dbe5c552347c901c09c56245e4742f73e56053e5b5d08a987fc"
Sep 10 10:35:08.105610 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.105591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:08.914771 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.914743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:08.914983 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:08.914846    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:08.914983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:08.914901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:08.915266 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:08.914981    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:09.095300 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.095276    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:35:09.095655 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.095633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" event={"ID":"1ac419bf-6e1c-482a-82dd-e6eb69c9ab44","Type":"ContainerStarted","Data":"3c25620dd8881dc2bec3c6bb2177a6f4e3edd604d393b58b86b63b3e6612193c"}
Sep 10 10:35:09.095944 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.095923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:09.113634 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.113607    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:09.129753 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.129707    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd" podStartSLOduration=10.503548064 podStartE2EDuration="28.129692839s" totalImagesPullingTime="17.626144775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:09.128107569 +0000 UTC m=+27.695588216" watchObservedRunningTime="2026-09-10 10:35:09.129692839 +0000 UTC m=+27.697173451"
Sep 10 10:35:09.314412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.314369    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lr2sm"]
Sep 10 10:35:09.314670 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.314637    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:09.314819 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:09.314793    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:09.317418 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.317374    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wp72z"]
Sep 10 10:35:09.317528 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.317513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:09.317648 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:09.317625    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:09.318052 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.318032    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-txgnh"]
Sep 10 10:35:09.318156 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:09.318126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:09.318227 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:09.318212    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:10.099586 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:10.099549    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="daaebc9ef4b42af2fc8ef3f9e35aa10ddd1b83203fbab364769e6695c87114db" exitCode=0
Sep 10 10:35:10.099942 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:10.099627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"daaebc9ef4b42af2fc8ef3f9e35aa10ddd1b83203fbab364769e6695c87114db"}
Sep 10 10:35:10.914658 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:10.914579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:10.914658 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:10.914624    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:10.914658 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:10.914661    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:10.914906 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:10.914679    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:10.914906 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:10.914730    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:10.914906 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:10.914820    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:11.245417 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:11.245391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:35:11.245770 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:11.245525    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 10:35:11.246032 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:11.246010    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pbtrf"
Sep 10 10:35:12.106867 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:12.106831    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="143d71ca306ef7478f47872a94f757d220f7b9dc318c53a2e617162f30421472" exitCode=0
Sep 10 10:35:12.107047 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:12.106912    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"143d71ca306ef7478f47872a94f757d220f7b9dc318c53a2e617162f30421472"}
Sep 10 10:35:12.914015 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:12.913980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:12.914622 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:12.913980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:12.914622 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:12.914113    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:12.914622 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:12.913980    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:12.914622 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:12.914189    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:12.914622 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:12.914297    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:14.914107 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:14.914073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:14.914718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:14.914073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:14.914718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:14.914087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:14.914718 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:14.914207    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lr2sm" podUID="e1723f71-9ccf-43ab-9ed4-40b79714af8d"
Sep 10 10:35:14.914718 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:14.914317    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-txgnh" podUID="2101398d-73f4-4b14-93ec-87ee7f493b6f"
Sep 10 10:35:14.914718 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:14.914417    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wp72z" podUID="f059301e-f05c-462f-9a6c-85ced79f641a"
Sep 10 10:35:15.214355 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.214323    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeReady"
Sep 10 10:35:15.214547 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.214477    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 10:35:15.261335 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.261307    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-644d479568-kdxmp"]
Sep 10 10:35:15.285397 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.285349    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j5d8r"]
Sep 10 10:35:15.285554 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.285504    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.288367 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.288342    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 10:35:15.288797 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.288769    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 10:35:15.291716 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.291672    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fw5f\""
Sep 10 10:35:15.291827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.291725    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 10:35:15.294680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.294288    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 10:35:15.298831 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.298810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kbb8r"]
Sep 10 10:35:15.298971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.298951    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.303940 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.303691    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 10:35:15.303940 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.303708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwxhn\""
Sep 10 10:35:15.303940 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.303729    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 10:35:15.316887 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.316863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644d479568-kdxmp"]
Sep 10 10:35:15.317012 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.316905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbb8r"]
Sep 10 10:35:15.317012 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.316932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5d8r"]
Sep 10 10:35:15.317122 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.317057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.320612 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.320587    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 10:35:15.320723 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.320627    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 10:35:15.320723 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.320701    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 10:35:15.320828 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.320633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bnwsz\""
Sep 10 10:35:15.430164 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430164 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430364 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81a2db82-e9d7-498f-9e64-959384efcd45-config-volume\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.430364 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-cert\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.430364 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430331    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430499 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686l2\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430499 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430499 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430620 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430620 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.430620 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9dz6\" (UniqueName: \"kubernetes.io/projected/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-kube-api-access-b9dz6\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.430620 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a2db82-e9d7-498f-9e64-959384efcd45-tmp-dir\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.430784 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-222rk\" (UniqueName: \"kubernetes.io/projected/81a2db82-e9d7-498f-9e64-959384efcd45-kube-api-access-222rk\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.430784 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.430744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.532287 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532287 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81a2db82-e9d7-498f-9e64-959384efcd45-config-volume\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.532533 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-cert\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.532533 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532533 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-686l2\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532533 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9dz6\" (UniqueName: \"kubernetes.io/projected/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-kube-api-access-b9dz6\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a2db82-e9d7-498f-9e64-959384efcd45-tmp-dir\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-222rk\" (UniqueName: \"kubernetes.io/projected/81a2db82-e9d7-498f-9e64-959384efcd45-kube-api-access-222rk\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.532732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.533057 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.532836    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:15.533057 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.532893    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:16.032876032 +0000 UTC m=+34.600356644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:15.533057 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.532947    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81a2db82-e9d7-498f-9e64-959384efcd45-config-volume\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.533218 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.533062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.533218 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.533103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.533218 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.533208    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:15.533371 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.533222    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:15.533371 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.533224    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.533371 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.533338    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:16.033318776 +0000 UTC m=+34.600799392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:15.533371 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.533348    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81a2db82-e9d7-498f-9e64-959384efcd45-tmp-dir\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.533590 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.533409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.537067 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.537043    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.537067 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.537061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.537248 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.537104    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-cert\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.543418 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.543372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-222rk\" (UniqueName: \"kubernetes.io/projected/81a2db82-e9d7-498f-9e64-959384efcd45-kube-api-access-222rk\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:15.543546 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.543526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-686l2\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.543906 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.543885    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:15.544038 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.544026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9dz6\" (UniqueName: \"kubernetes.io/projected/2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95-kube-api-access-b9dz6\") pod \"ingress-canary-kbb8r\" (UID: \"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95\") " pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.626433 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.626394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbb8r"
Sep 10 10:35:15.633737 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.633705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:15.633886 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.633802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:15.633886 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.633862    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:35:15.633999 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.633896    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 10:35:15.633999 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.633938    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs podName:f059301e-f05c-462f-9a6c-85ced79f641a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:47.633916878 +0000 UTC m=+66.201397493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs") pod "network-metrics-daemon-wp72z" (UID: "f059301e-f05c-462f-9a6c-85ced79f641a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 10:35:15.633999 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.633957    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret podName:e1723f71-9ccf-43ab-9ed4-40b79714af8d nodeName:}" failed. No retries permitted until 2026-09-10 10:35:47.633947855 +0000 UTC m=+66.201428469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret") pod "global-pull-secret-syncer-lr2sm" (UID: "e1723f71-9ccf-43ab-9ed4-40b79714af8d") : object "kube-system"/"original-pull-secret" not registered
Sep 10 10:35:15.734718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:15.734685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:15.734891 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.734865    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 10:35:15.734891 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.734890    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 10:35:15.734999 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.734899    2583 projected.go:196] Error preparing data for projected volume kube-api-access-r4dmg for pod openshift-network-diagnostics/network-check-target-txgnh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:35:15.734999 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:15.734962    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg podName:2101398d-73f4-4b14-93ec-87ee7f493b6f nodeName:}" failed. No retries permitted until 2026-09-10 10:35:47.734945263 +0000 UTC m=+66.302425864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4dmg" (UniqueName: "kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg") pod "network-check-target-txgnh" (UID: "2101398d-73f4-4b14-93ec-87ee7f493b6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 10:35:16.037541 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.037499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:16.037541 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.037550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:16.038278 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:16.037678    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:16.038278 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:16.037725    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:16.038278 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:16.037743    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:16.038278 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:16.037760    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:17.037738273 +0000 UTC m=+35.605218870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:16.038278 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:16.037795    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:17.037779862 +0000 UTC m=+35.605260459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:16.454107 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.453935    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbb8r"]
Sep 10 10:35:16.475265 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:16.475236    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbc6d4c_f9b6_4e05_8830_59f6b6ca3a95.slice/crio-2a6d7d2b0aae54de18a0be9142c29420c8fbd8a843cef4cf5638b7d3cec8b134 WatchSource:0}: Error finding container 2a6d7d2b0aae54de18a0be9142c29420c8fbd8a843cef4cf5638b7d3cec8b134: Status 404 returned error can't find the container with id 2a6d7d2b0aae54de18a0be9142c29420c8fbd8a843cef4cf5638b7d3cec8b134
Sep 10 10:35:16.914758 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.914726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:16.914903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.914726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:16.914903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.914726    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:16.917502 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.917482    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 10:35:16.918477 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.918460    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 10:35:16.918608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.918493    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skrtq\""
Sep 10 10:35:16.918608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.918468    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 10:35:16.918608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.918468    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 10:35:16.918608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:16.918468    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrr5x\""
Sep 10 10:35:17.046019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:17.045929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:17.046016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:17.046055    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:17.046134    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.046117673 +0000 UTC m=+37.613598277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:17.046170    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:17.046183    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:17.046373 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:17.046256    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.046239059 +0000 UTC m=+37.613719676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:17.120128 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:17.120096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbb8r" event={"ID":"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95","Type":"ContainerStarted","Data":"2a6d7d2b0aae54de18a0be9142c29420c8fbd8a843cef4cf5638b7d3cec8b134"}
Sep 10 10:35:17.122991 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:17.122962    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="d1a20897e9273ecb7210b6f036ce468eb35be83b471e62760b8bad7e0e92a7b0" exitCode=0
Sep 10 10:35:17.123110 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:17.123005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"d1a20897e9273ecb7210b6f036ce468eb35be83b471e62760b8bad7e0e92a7b0"}
Sep 10 10:35:18.128225 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:18.128192    2583 generic.go:356] "Generic (PLEG): container finished" podID="4439fa18-fa8d-42a7-a0fa-734a4ee2e202" containerID="1db97cfbf3c919aa5a7ea95bdf1d03045cacf27468ee996e62ee95a61ad972c4" exitCode=0
Sep 10 10:35:18.128602 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:18.128252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerDied","Data":"1db97cfbf3c919aa5a7ea95bdf1d03045cacf27468ee996e62ee95a61ad972c4"}
Sep 10 10:35:19.062746 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:19.062483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:19.062908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:19.062782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:19.062908 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:19.062625    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:19.062908 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:19.062889    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:23.062855688 +0000 UTC m=+41.630336282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:19.063011 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:19.062927    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:19.063011 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:19.062940    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:19.063011 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:19.062991    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:23.062976029 +0000 UTC m=+41.630456638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:19.133537 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:19.133509    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" event={"ID":"4439fa18-fa8d-42a7-a0fa-734a4ee2e202","Type":"ContainerStarted","Data":"66a5b0bf926e137ebafee2886ebd806998760b63918e496dabb1e9c50f19f45f"}
Sep 10 10:35:19.157938 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:19.157895    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pfwcd" podStartSLOduration=8.883337381 podStartE2EDuration="37.157877222s" totalImagesPullingTime="28.274539841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:19.156884478 +0000 UTC m=+37.724365113" watchObservedRunningTime="2026-09-10 10:35:19.157877222 +0000 UTC m=+37.725357838"
Sep 10 10:35:20.136992 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.136951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbb8r" event={"ID":"2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95","Type":"ContainerStarted","Data":"c344302d895b169d390d84535765420b32681afbc8bc4eee3f7bc29a712f65f3"}
Sep 10 10:35:20.153991 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.153932    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kbb8r" podStartSLOduration=2.533138035 podStartE2EDuration="5.153912292s" totalImagesPullingTime="2.620774257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:20.153282473 +0000 UTC m=+38.720763099" watchObservedRunningTime="2026-09-10 10:35:20.153912292 +0000 UTC m=+38.721392907"
Sep 10 10:35:20.432494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.432468    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dgn5m"]
Sep 10 10:35:20.434306 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.434285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.436765 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.436736    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 10:35:20.436869 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.436771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdf7z\""
Sep 10 10:35:20.436869 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.436830    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 10:35:20.437723 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.437704    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 10:35:20.437723 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.437720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 10:35:20.445515 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.445494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgn5m"]
Sep 10 10:35:20.514397 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.514357    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d9nkz"]
Sep 10 10:35:20.516114 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.516100    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:20.520566 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.520543    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 10:35:20.520566 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.520555    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 10:35:20.520759 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.520586    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-92tq2\""
Sep 10 10:35:20.529178 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.529154    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d9nkz"]
Sep 10 10:35:20.573554 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.573528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfff\" (UniqueName: \"kubernetes.io/projected/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-api-access-8mfff\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.573660 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.573568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91dde24f-34bd-4b2a-8779-8d429b7e56ed-crio-socket\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.573660 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.573648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91dde24f-34bd-4b2a-8779-8d429b7e56ed-data-volume\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.573728 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.573705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.573760 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.573729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.674921 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.674887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfff\" (UniqueName: \"kubernetes.io/projected/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-api-access-8mfff\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.674996 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.674942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91dde24f-34bd-4b2a-8779-8d429b7e56ed-crio-socket\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.674996 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.674964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:20.675108 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91dde24f-34bd-4b2a-8779-8d429b7e56ed-data-volume\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.675166 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.675244 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-nginx-conf\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:20.675244 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.675244 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91dde24f-34bd-4b2a-8779-8d429b7e56ed-crio-socket\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.675408 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.675252    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:20.675408 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.675324    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:21.175301192 +0000 UTC m=+39.742781804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:20.675408 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.675260    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 10:35:20.675557 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.675416    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:21.175400641 +0000 UTC m=+39.742881259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : configmap "kube-rbac-proxy" not found
Sep 10 10:35:20.675557 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.675414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91dde24f-34bd-4b2a-8779-8d429b7e56ed-data-volume\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.689084 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.689025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfff\" (UniqueName: \"kubernetes.io/projected/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-api-access-8mfff\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:20.775782 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.775735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:20.775961 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.775883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-nginx-conf\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:20.775961 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.775887    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:20.776066 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:20.776019    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:21.276000523 +0000 UTC m=+39.843481134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:20.776515 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:20.776495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-nginx-conf\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:21.177977 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.177952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:21.178310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.177988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:21.178310 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.178086    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:21.178310 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.178140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:22.178125734 +0000 UTC m=+40.745606328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:21.178310 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.178166    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 10:35:21.178310 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.178212    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:22.178201456 +0000 UTC m=+40.745682071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : configmap "kube-rbac-proxy" not found
Sep 10 10:35:21.278973 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.278941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:21.279123 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.279082    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:21.279183 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:21.279139    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:22.279122324 +0000 UTC m=+40.846602918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:21.958099 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.958069    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"]
Sep 10 10:35:21.986336 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.986311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"]
Sep 10 10:35:21.986494 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.986435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"
Sep 10 10:35:21.988903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.988870    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pzbsp\""
Sep 10 10:35:21.988903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.988894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 10:35:21.989858 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:21.989844    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 10:35:22.013763 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.013743    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qs9j_4dc14834-1f7a-4d8d-8a76-666d384f4857/dns-node-resolver/0.log"
Sep 10 10:35:22.087485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.087451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhfg\" (UniqueName: \"kubernetes.io/projected/6f9c19fb-b893-41c9-a51a-cdef33d180ee-kube-api-access-vmhfg\") pod \"migrator-fdbb8fdff-hklp5\" (UID: \"6f9c19fb-b893-41c9-a51a-cdef33d180ee\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"
Sep 10 10:35:22.188132 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.188099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhfg\" (UniqueName: \"kubernetes.io/projected/6f9c19fb-b893-41c9-a51a-cdef33d180ee-kube-api-access-vmhfg\") pod \"migrator-fdbb8fdff-hklp5\" (UID: \"6f9c19fb-b893-41c9-a51a-cdef33d180ee\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.188155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.188178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.188248    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.188296    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:24.188281663 +0000 UTC m=+42.755762257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : configmap "kube-rbac-proxy" not found
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.188313    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:22.188482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.188368    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:24.188350383 +0000 UTC m=+42.755830997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:22.196942 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.196920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhfg\" (UniqueName: \"kubernetes.io/projected/6f9c19fb-b893-41c9-a51a-cdef33d180ee-kube-api-access-vmhfg\") pod \"migrator-fdbb8fdff-hklp5\" (UID: \"6f9c19fb-b893-41c9-a51a-cdef33d180ee\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"
Sep 10 10:35:22.289479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.289407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:22.289612 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.289541    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:22.289612 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:22.289607    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:24.289589191 +0000 UTC m=+42.857069784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:22.295313 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.295295    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"
Sep 10 10:35:22.579999 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:22.579911    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5"]
Sep 10 10:35:22.583733 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:22.583707    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9c19fb_b893_41c9_a51a_cdef33d180ee.slice/crio-b52a16aa5eba9c94ab8fed149c9cc2029e82adaf96f31e264dc9f1101af3b535 WatchSource:0}: Error finding container b52a16aa5eba9c94ab8fed149c9cc2029e82adaf96f31e264dc9f1101af3b535: Status 404 returned error can't find the container with id b52a16aa5eba9c94ab8fed149c9cc2029e82adaf96f31e264dc9f1101af3b535
Sep 10 10:35:23.097049 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:23.097004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:23.097218 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:23.097064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:23.097218 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:23.097159    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:23.097218 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:23.097170    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:23.097218 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:23.097168    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:23.097218 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:23.097218    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:31.097204834 +0000 UTC m=+49.664685429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:23.097376 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:23.097231    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:31.097225109 +0000 UTC m=+49.664705702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:23.145143 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:23.145113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5" event={"ID":"6f9c19fb-b893-41c9-a51a-cdef33d180ee","Type":"ContainerStarted","Data":"b52a16aa5eba9c94ab8fed149c9cc2029e82adaf96f31e264dc9f1101af3b535"}
Sep 10 10:35:23.214717 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:23.214689    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqk2p_156d5bf9-fbbf-4bed-842d-cbd047424433/node-ca/0.log"
Sep 10 10:35:23.614481 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:23.614454    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbb8r_2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95/serve-healthcheck-canary/0.log"
Sep 10 10:35:24.206058 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:24.206021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:24.206058 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:24.206063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:24.206253 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.206145    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 10:35:24.206253 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.206179    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:24.206253 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.206190    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:28.206176583 +0000 UTC m=+46.773657183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : configmap "kube-rbac-proxy" not found
Sep 10 10:35:24.206253 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.206248    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:28.206230542 +0000 UTC m=+46.773711142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:24.307595 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:24.307523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:24.307901 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.307674    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:24.307901 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:24.307733    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:28.307714467 +0000 UTC m=+46.875195062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:25.151684 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:25.151632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5" event={"ID":"6f9c19fb-b893-41c9-a51a-cdef33d180ee","Type":"ContainerStarted","Data":"37680e2dd9fb03950e839b5d579be0cc4ab05a057a0c9e83484f198fcd2c3cb8"}
Sep 10 10:35:25.151877 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:25.151707    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5" event={"ID":"6f9c19fb-b893-41c9-a51a-cdef33d180ee","Type":"ContainerStarted","Data":"698afbbec4c9f3d960bc3aa029f387f8f93c27841f77042ebcf56b4c050aaeae"}
Sep 10 10:35:25.169389 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:25.169301    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hklp5" podStartSLOduration=2.530973017 podStartE2EDuration="4.169281616s" totalImagesPullingTime="1.638308599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:25.168574962 +0000 UTC m=+43.736055597" watchObservedRunningTime="2026-09-10 10:35:25.169281616 +0000 UTC m=+43.736762234"
Sep 10 10:35:28.239399 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:28.239351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:28.239835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:28.239490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:28.239835 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:28.239624    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:28.239965 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:28.239944    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls podName:91dde24f-34bd-4b2a-8779-8d429b7e56ed nodeName:}" failed. No retries permitted until 2026-09-10 10:35:36.239913909 +0000 UTC m=+54.807394526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dgn5m" (UID: "91dde24f-34bd-4b2a-8779-8d429b7e56ed") : secret "insights-runtime-extractor-tls" not found
Sep 10 10:35:28.240906 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:28.240879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91dde24f-34bd-4b2a-8779-8d429b7e56ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:28.340139 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:28.340101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:28.340287 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:28.340249    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:28.340327 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:28.340314    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:36.34029806 +0000 UTC m=+54.907778654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:31.161080 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:31.161039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:31.161093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:31.161187    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:31.161249    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls podName:81a2db82-e9d7-498f-9e64-959384efcd45 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:47.161233176 +0000 UTC m=+65.728713770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls") pod "dns-default-j5d8r" (UID: "81a2db82-e9d7-498f-9e64-959384efcd45") : secret "dns-default-metrics-tls" not found
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:31.161195    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:31.161288    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644d479568-kdxmp: secret "image-registry-tls" not found
Sep 10 10:35:31.161482 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:31.161329    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls podName:98981264-71da-4a70-94b2-8218d261a5d5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:47.161317818 +0000 UTC m=+65.728798429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls") pod "image-registry-644d479568-kdxmp" (UID: "98981264-71da-4a70-94b2-8218d261a5d5") : secret "image-registry-tls" not found
Sep 10 10:35:36.300488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:36.300429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:36.302734 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:36.302698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91dde24f-34bd-4b2a-8779-8d429b7e56ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dgn5m\" (UID: \"91dde24f-34bd-4b2a-8779-8d429b7e56ed\") " pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:36.343807 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:36.343779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dgn5m"
Sep 10 10:35:36.401964 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:36.401928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:36.402120 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:36.402099    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 10:35:36.402197 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:36.402185    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert podName:2f8524d2-44e4-4efa-8d20-6a59c5d16c36 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:52.402163423 +0000 UTC m=+70.969644034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d9nkz" (UID: "2f8524d2-44e4-4efa-8d20-6a59c5d16c36") : secret "networking-console-plugin-cert" not found
Sep 10 10:35:36.611354 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:36.611279    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dgn5m"]
Sep 10 10:35:36.614440 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:36.614415    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91dde24f_34bd_4b2a_8779_8d429b7e56ed.slice/crio-330f0b0f7ab25916d9804c874ab710bb631e12ce91055f48cdad1a72ceb5d684 WatchSource:0}: Error finding container 330f0b0f7ab25916d9804c874ab710bb631e12ce91055f48cdad1a72ceb5d684: Status 404 returned error can't find the container with id 330f0b0f7ab25916d9804c874ab710bb631e12ce91055f48cdad1a72ceb5d684
Sep 10 10:35:37.181271 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:37.181238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgn5m" event={"ID":"91dde24f-34bd-4b2a-8779-8d429b7e56ed","Type":"ContainerStarted","Data":"db0eb7e26bdfe30606c79b4bd703ade17190e6932b0d89f1e2536b0a22557403"}
Sep 10 10:35:37.181456 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:37.181291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgn5m" event={"ID":"91dde24f-34bd-4b2a-8779-8d429b7e56ed","Type":"ContainerStarted","Data":"330f0b0f7ab25916d9804c874ab710bb631e12ce91055f48cdad1a72ceb5d684"}
Sep 10 10:35:38.185416 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:38.185369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgn5m" event={"ID":"91dde24f-34bd-4b2a-8779-8d429b7e56ed","Type":"ContainerStarted","Data":"71a09eb49ec999a6bbb06cc7922c84ee48513606271f34bbf2160ff86ff25bf7"}
Sep 10 10:35:39.192767 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:39.192730    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dgn5m" event={"ID":"91dde24f-34bd-4b2a-8779-8d429b7e56ed","Type":"ContainerStarted","Data":"7465306c4e1062b6207a15ef05385f8273660bcaa9a249f5617f975376c58123"}
Sep 10 10:35:39.210862 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:39.210818    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dgn5m" podStartSLOduration=16.897722541 podStartE2EDuration="19.21080599s" totalImagesPullingTime="2.313083449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:35:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:39.210007812 +0000 UTC m=+57.777488447" watchObservedRunningTime="2026-09-10 10:35:39.21080599 +0000 UTC m=+57.778286606"
Sep 10 10:35:41.118221 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:41.118193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpttd"
Sep 10 10:35:45.727853 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.727813    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"]
Sep 10 10:35:45.731198 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.731180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.733668 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.733644    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 10:35:45.734288 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.734273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 10:35:45.734873 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.734845    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 10:35:45.734954 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.734925    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 10:35:45.734954 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.734925    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 10:35:45.735289 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.735272    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 10:35:45.735399 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.735300    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 10:35:45.742426 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.742407    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"]
Sep 10 10:35:45.777319 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.777491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/566db680-9707-4e1e-85c6-b3811e798da5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.777491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.777491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlh6r\" (UniqueName: \"kubernetes.io/projected/566db680-9707-4e1e-85c6-b3811e798da5-kube-api-access-jlh6r\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.777648 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.777648 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.777539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.810346 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.810314    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644d479568-kdxmp"]
Sep 10 10:35:45.810581 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:45.810558    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-644d479568-kdxmp" podUID="98981264-71da-4a70-94b2-8218d261a5d5"
Sep 10 10:35:45.878660 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.878823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.878823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/566db680-9707-4e1e-85c6-b3811e798da5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.878823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.878823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlh6r\" (UniqueName: \"kubernetes.io/projected/566db680-9707-4e1e-85c6-b3811e798da5-kube-api-access-jlh6r\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.878823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.878792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.879599 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.879571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/566db680-9707-4e1e-85c6-b3811e798da5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.881266 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.881241    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-ca\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.881266 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.881256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.881724 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.881703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.881763 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.881746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/566db680-9707-4e1e-85c6-b3811e798da5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:45.893088 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:45.893052    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlh6r\" (UniqueName: \"kubernetes.io/projected/566db680-9707-4e1e-85c6-b3811e798da5-kube-api-access-jlh6r\") pod \"cluster-proxy-proxy-agent-6694c6849c-kmpkn\" (UID: \"566db680-9707-4e1e-85c6-b3811e798da5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:46.054799 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.054713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"
Sep 10 10:35:46.212656 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.212623    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:46.218519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.218496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:46.282538 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282503    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282616    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282969 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282784    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-686l2\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:46.282969 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:35:46.283071 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.282996    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:35:46.283124 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.283095    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-registry-certificates\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.283170 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.283121    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98981264-71da-4a70-94b2-8218d261a5d5-ca-trust-extracted\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.283170 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.283152    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:35:46.284912 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.284886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:35:46.284912 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.284902    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2" (OuterVolumeSpecName: "kube-api-access-686l2") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "kube-api-access-686l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:35:46.285122 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.285106    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:35:46.285171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.285123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:35:46.324433 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.324345    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn"]
Sep 10 10:35:46.327097 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:46.327068    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod566db680_9707_4e1e_85c6_b3811e798da5.slice/crio-6d9cf6364afe998aa97a30b4f23ba8a86b8a93616345595a3bcf78146651fba2 WatchSource:0}: Error finding container 6d9cf6364afe998aa97a30b4f23ba8a86b8a93616345595a3bcf78146651fba2: Status 404 returned error can't find the container with id 6d9cf6364afe998aa97a30b4f23ba8a86b8a93616345595a3bcf78146651fba2
Sep 10 10:35:46.384491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.384455    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-image-registry-private-configuration\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.384491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.384485    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98981264-71da-4a70-94b2-8218d261a5d5-trusted-ca\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.384491 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.384496    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-bound-sa-token\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.384701 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.384503    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98981264-71da-4a70-94b2-8218d261a5d5-installation-pull-secrets\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:46.384701 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:46.384512    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-686l2\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-kube-api-access-686l2\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:47.192171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.192135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:47.192650 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.192198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:47.195262 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.195208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/81a2db82-e9d7-498f-9e64-959384efcd45-metrics-tls\") pod \"dns-default-j5d8r\" (UID: \"81a2db82-e9d7-498f-9e64-959384efcd45\") " pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:47.195449 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.195275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"image-registry-644d479568-kdxmp\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") " pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:47.217572 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.217543    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644d479568-kdxmp"
Sep 10 10:35:47.217824 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.217798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn" event={"ID":"566db680-9707-4e1e-85c6-b3811e798da5","Type":"ContainerStarted","Data":"6d9cf6364afe998aa97a30b4f23ba8a86b8a93616345595a3bcf78146651fba2"}
Sep 10 10:35:47.293163 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.293130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") pod \"98981264-71da-4a70-94b2-8218d261a5d5\" (UID: \"98981264-71da-4a70-94b2-8218d261a5d5\") "
Sep 10 10:35:47.295718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.295691    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "98981264-71da-4a70-94b2-8218d261a5d5" (UID: "98981264-71da-4a70-94b2-8218d261a5d5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:35:47.394358 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.394320    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98981264-71da-4a70-94b2-8218d261a5d5-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:35:47.411543 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.411517    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwxhn\""
Sep 10 10:35:47.419835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.419804    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:47.558765 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.558728    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644d479568-kdxmp"]
Sep 10 10:35:47.561052 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.561024    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-644d479568-kdxmp"]
Sep 10 10:35:47.698512 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.697925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:47.698512 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.698020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:47.700923 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.700683    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 10:35:47.700923 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.700723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 10:35:47.711217 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.711185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f059301e-f05c-462f-9a6c-85ced79f641a-metrics-certs\") pod \"network-metrics-daemon-wp72z\" (UID: \"f059301e-f05c-462f-9a6c-85ced79f641a\") " pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:47.711370 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.711351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e1723f71-9ccf-43ab-9ed4-40b79714af8d-original-pull-secret\") pod \"global-pull-secret-syncer-lr2sm\" (UID: \"e1723f71-9ccf-43ab-9ed4-40b79714af8d\") " pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:47.715240 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.715215    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5d8r"]
Sep 10 10:35:47.798685 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.798562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:47.801138 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.801109    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 10:35:47.811418 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.811374    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 10:35:47.823010 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.822983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4dmg\" (UniqueName: \"kubernetes.io/projected/2101398d-73f4-4b14-93ec-87ee7f493b6f-kube-api-access-r4dmg\") pod \"network-check-target-txgnh\" (UID: \"2101398d-73f4-4b14-93ec-87ee7f493b6f\") " pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:47.824584 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.824562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lr2sm"
Sep 10 10:35:47.832014 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.831937    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrr5x\""
Sep 10 10:35:47.836146 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.836037    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skrtq\""
Sep 10 10:35:47.839985 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.839964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wp72z"
Sep 10 10:35:47.844156 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.844131    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:47.918598 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:47.918570    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98981264-71da-4a70-94b2-8218d261a5d5" path="/var/lib/kubelet/pods/98981264-71da-4a70-94b2-8218d261a5d5/volumes"
Sep 10 10:35:48.401640 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:48.401600    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a2db82_e9d7_498f_9e64_959384efcd45.slice/crio-f421045381f4bd0a16efb7a76467e6dd6105451ce7d514edb275b4ff3b17ec7a WatchSource:0}: Error finding container f421045381f4bd0a16efb7a76467e6dd6105451ce7d514edb275b4ff3b17ec7a: Status 404 returned error can't find the container with id f421045381f4bd0a16efb7a76467e6dd6105451ce7d514edb275b4ff3b17ec7a
Sep 10 10:35:48.685235 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:48.685201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lr2sm"]
Sep 10 10:35:48.686413 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:48.686338    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-txgnh"]
Sep 10 10:35:48.687392 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:48.687331    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wp72z"]
Sep 10 10:35:49.063254 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.063176    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"]
Sep 10 10:35:49.088624 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.088597    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"]
Sep 10 10:35:49.088762 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.088711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:49.091632 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.091598    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 10:35:49.091846 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.091831    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-w9dqn\""
Sep 10 10:35:49.210606 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.210536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-zm666\" (UID: \"0608005a-8bae-44c3-82e0-7c29ffd496a5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:49.225595 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.225557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5d8r" event={"ID":"81a2db82-e9d7-498f-9e64-959384efcd45","Type":"ContainerStarted","Data":"f421045381f4bd0a16efb7a76467e6dd6105451ce7d514edb275b4ff3b17ec7a"}
Sep 10 10:35:49.311896 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.311856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-zm666\" (UID: \"0608005a-8bae-44c3-82e0-7c29ffd496a5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:49.312105 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:49.312030    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 10:35:49.312180 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:49.312109    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates podName:0608005a-8bae-44c3-82e0-7c29ffd496a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:49.812087416 +0000 UTC m=+68.379568016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-zm666" (UID: "0608005a-8bae-44c3-82e0-7c29ffd496a5") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 10:35:49.698319 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:49.698284    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf059301e_f05c_462f_9a6c_85ced79f641a.slice/crio-402bbd7052615deafcc31b35f1ffd40ba34276cc2d75c0e4e697191d11b4dbfb WatchSource:0}: Error finding container 402bbd7052615deafcc31b35f1ffd40ba34276cc2d75c0e4e697191d11b4dbfb: Status 404 returned error can't find the container with id 402bbd7052615deafcc31b35f1ffd40ba34276cc2d75c0e4e697191d11b4dbfb
Sep 10 10:35:49.698975 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:49.698951    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1723f71_9ccf_43ab_9ed4_40b79714af8d.slice/crio-2174281669f59d1946b6d6fba74d5fe5cf4880c5d27ab28b9f0bfb8a3a33e95b WatchSource:0}: Error finding container 2174281669f59d1946b6d6fba74d5fe5cf4880c5d27ab28b9f0bfb8a3a33e95b: Status 404 returned error can't find the container with id 2174281669f59d1946b6d6fba74d5fe5cf4880c5d27ab28b9f0bfb8a3a33e95b
Sep 10 10:35:49.699597 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:49.699455    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2101398d_73f4_4b14_93ec_87ee7f493b6f.slice/crio-ca1422fb4de4619ba05dc21aaafbc19b18313afffa84c4fbd499e0cb33969caa WatchSource:0}: Error finding container ca1422fb4de4619ba05dc21aaafbc19b18313afffa84c4fbd499e0cb33969caa: Status 404 returned error can't find the container with id ca1422fb4de4619ba05dc21aaafbc19b18313afffa84c4fbd499e0cb33969caa
Sep 10 10:35:49.815731 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.815688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-zm666\" (UID: \"0608005a-8bae-44c3-82e0-7c29ffd496a5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:49.818106 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.818075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0608005a-8bae-44c3-82e0-7c29ffd496a5-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-zm666\" (UID: \"0608005a-8bae-44c3-82e0-7c29ffd496a5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:49.999423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:49.999342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:50.233290 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:50.233212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn" event={"ID":"566db680-9707-4e1e-85c6-b3811e798da5","Type":"ContainerStarted","Data":"b4f2cc3a39d14e0464981cc80a60fecb2e546ecbf9f73afb151a3b917a2e1975"}
Sep 10 10:35:50.235229 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:50.235126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wp72z" event={"ID":"f059301e-f05c-462f-9a6c-85ced79f641a","Type":"ContainerStarted","Data":"402bbd7052615deafcc31b35f1ffd40ba34276cc2d75c0e4e697191d11b4dbfb"}
Sep 10 10:35:50.237085 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:50.237053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lr2sm" event={"ID":"e1723f71-9ccf-43ab-9ed4-40b79714af8d","Type":"ContainerStarted","Data":"2174281669f59d1946b6d6fba74d5fe5cf4880c5d27ab28b9f0bfb8a3a33e95b"}
Sep 10 10:35:50.238822 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:50.238797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-txgnh" event={"ID":"2101398d-73f4-4b14-93ec-87ee7f493b6f","Type":"ContainerStarted","Data":"ca1422fb4de4619ba05dc21aaafbc19b18313afffa84c4fbd499e0cb33969caa"}
Sep 10 10:35:50.374856 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:50.374824    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"]
Sep 10 10:35:50.379068 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:50.379038    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0608005a_8bae_44c3_82e0_7c29ffd496a5.slice/crio-0a186622ca4cf524c1ccdf5dbbbf893a49083d98c27eeaea7260c501d9c685cc WatchSource:0}: Error finding container 0a186622ca4cf524c1ccdf5dbbbf893a49083d98c27eeaea7260c501d9c685cc: Status 404 returned error can't find the container with id 0a186622ca4cf524c1ccdf5dbbbf893a49083d98c27eeaea7260c501d9c685cc
Sep 10 10:35:51.244203 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:51.244117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666" event={"ID":"0608005a-8bae-44c3-82e0-7c29ffd496a5","Type":"ContainerStarted","Data":"0a186622ca4cf524c1ccdf5dbbbf893a49083d98c27eeaea7260c501d9c685cc"}
Sep 10 10:35:51.248189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:51.247600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn" event={"ID":"566db680-9707-4e1e-85c6-b3811e798da5","Type":"ContainerStarted","Data":"f9fc146c8f33aba1054ec1b58010807a36934c0bb896e2d663eaa2384b6784c0"}
Sep 10 10:35:51.248189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:51.247648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn" event={"ID":"566db680-9707-4e1e-85c6-b3811e798da5","Type":"ContainerStarted","Data":"3f7534e9e23ca7b2ba8fd5a155d62aa0027bab445fa4a99f7dd4accf6a5c685e"}
Sep 10 10:35:51.249999 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:51.249971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wp72z" event={"ID":"f059301e-f05c-462f-9a6c-85ced79f641a","Type":"ContainerStarted","Data":"c0a6be4e3ed08039ed3aad6585ef129d27dbd9a45bbcbf738989dc8590fced7a"}
Sep 10 10:35:51.269519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:51.269466    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6694c6849c-kmpkn" podStartSLOduration=2.491155459 podStartE2EDuration="6.269447634s" totalImagesPullingTime="3.778292175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:51.267216727 +0000 UTC m=+69.834697342" watchObservedRunningTime="2026-09-10 10:35:51.269447634 +0000 UTC m=+69.836928249"
Sep 10 10:35:52.258637 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.258597    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5d8r" event={"ID":"81a2db82-e9d7-498f-9e64-959384efcd45","Type":"ContainerStarted","Data":"f1e55aeb4f567c4fffe3e4ba878fc1980ee6675f19590198f370346101e54287"}
Sep 10 10:35:52.263131 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.261017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666" event={"ID":"0608005a-8bae-44c3-82e0-7c29ffd496a5","Type":"ContainerStarted","Data":"bd0039b800aa305726ef88f68ff291c894a6bead031423ce573456fa97fb5c5c"}
Sep 10 10:35:52.263131 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.261981    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:52.268196 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.267755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wp72z" event={"ID":"f059301e-f05c-462f-9a6c-85ced79f641a","Type":"ContainerStarted","Data":"fbbe438890c3a38022f11b0c4e8e6c7a9e789401607052034c7882f6667d4a67"}
Sep 10 10:35:52.268903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.268882    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666"
Sep 10 10:35:52.278940 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.278730    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-zm666" podStartSLOduration=1.5751593640000001 podStartE2EDuration="3.278709731s" totalImagesPullingTime="1.703550367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:52.278690825 +0000 UTC m=+70.846171459" watchObservedRunningTime="2026-09-10 10:35:52.278709731 +0000 UTC m=+70.846190348"
Sep 10 10:35:52.296778 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.296733    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wp72z" podStartSLOduration=69.060589744 podStartE2EDuration="1m10.296709454s" totalImagesPullingTime="1.23611971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:52.29399066 +0000 UTC m=+70.861471290" watchObservedRunningTime="2026-09-10 10:35:52.296709454 +0000 UTC m=+70.864190068"
Sep 10 10:35:52.436823 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.436790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:52.440191 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.440153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2f8524d2-44e4-4efa-8d20-6a59c5d16c36-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d9nkz\" (UID: \"2f8524d2-44e4-4efa-8d20-6a59c5d16c36\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:52.627143 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.627054    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-92tq2\""
Sep 10 10:35:52.635476 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:52.635205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz"
Sep 10 10:35:53.273510 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:53.273466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5d8r" event={"ID":"81a2db82-e9d7-498f-9e64-959384efcd45","Type":"ContainerStarted","Data":"e82d5ad315638a04d639356b5fb01d6eaec428fac432d83a34c1c47469676c18"}
Sep 10 10:35:53.294633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:53.294573    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j5d8r" podStartSLOduration=34.612460638 podStartE2EDuration="38.294557031s" totalImagesPullingTime="3.682096393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:53.293912997 +0000 UTC m=+71.861393614" watchObservedRunningTime="2026-09-10 10:35:53.294557031 +0000 UTC m=+71.862037647"
Sep 10 10:35:54.277536 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:54.277488    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:35:55.033077 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.032979    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d9nkz"]
Sep 10 10:35:55.282082 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.282045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lr2sm" event={"ID":"e1723f71-9ccf-43ab-9ed4-40b79714af8d","Type":"ContainerStarted","Data":"5deb54bea4f33bff8cd50265f4d0758a95f434c6f4125df3e8df502a77ef177c"}
Sep 10 10:35:55.283807 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.283667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-txgnh" event={"ID":"2101398d-73f4-4b14-93ec-87ee7f493b6f","Type":"ContainerStarted","Data":"959e46a5cf528d082b36833f6b80d387ef5622d39a11c3f23b5e322946656572"}
Sep 10 10:35:55.283807 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.283799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:35:55.285013 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.284990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz" event={"ID":"2f8524d2-44e4-4efa-8d20-6a59c5d16c36","Type":"ContainerStarted","Data":"a4f304966aa60b5f258e0559ed91370e57e4ed67ce794c634cc5f92f9aab8e7a"}
Sep 10 10:35:55.299971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.299932    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lr2sm" podStartSLOduration=68.228792993 podStartE2EDuration="1m13.299918124s" totalImagesPullingTime="5.071125131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:55.299081784 +0000 UTC m=+73.866562419" watchObservedRunningTime="2026-09-10 10:35:55.299918124 +0000 UTC m=+73.867398739"
Sep 10 10:35:55.316897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:55.316853    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-txgnh" podStartSLOduration=68.249064531 podStartE2EDuration="1m13.3168369s" totalImagesPullingTime="5.067772369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:55.316097793 +0000 UTC m=+73.883578427" watchObservedRunningTime="2026-09-10 10:35:55.3168369 +0000 UTC m=+73.884317940"
Sep 10 10:35:57.293340 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:57.293299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz" event={"ID":"2f8524d2-44e4-4efa-8d20-6a59c5d16c36","Type":"ContainerStarted","Data":"bd784239905a755ac4681325ff6d92e36a863a341cba9bff502764f53fbd5d3d"}
Sep 10 10:35:58.540339 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.540279    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-d9nkz" podStartSLOduration=37.316995414 podStartE2EDuration="38.54026193s" totalImagesPullingTime="1.223266516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:57.31082187 +0000 UTC m=+75.878302486" watchObservedRunningTime="2026-09-10 10:35:58.54026193 +0000 UTC m=+77.107742575"
Sep 10 10:35:58.540827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.540516    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9kqvg"]
Sep 10 10:35:58.544862 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.544841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.551737 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.551716    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 10:35:58.552928 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.552908    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 10:35:58.553015 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.552948    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 10:35:58.553422 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.553404    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 10:35:58.553422 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.553417    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 10:35:58.553513 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.553405    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 10:35:58.554964 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.554948    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4xqbg\""
Sep 10 10:35:58.680519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-root\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-wtmp\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680624    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66zfx\" (UniqueName: \"kubernetes.io/projected/a82b243a-767d-4ebd-8fb7-31164db854db-kube-api-access-66zfx\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-sys\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-metrics-client-ca\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-tls\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.680901 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.680732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-textfile\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781180 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-sys\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781180 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-metrics-client-ca\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-tls\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-textfile\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-sys\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-root\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781462 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-wtmp\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781913 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66zfx\" (UniqueName: \"kubernetes.io/projected/a82b243a-767d-4ebd-8fb7-31164db854db-kube-api-access-66zfx\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781913 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-root\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781913 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-textfile\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781913 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-wtmp\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.781913 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781848    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-metrics-client-ca\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.782107 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.781927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.783770 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.783748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.783770 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.783765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a82b243a-767d-4ebd-8fb7-31164db854db-node-exporter-tls\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.795265 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.795215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66zfx\" (UniqueName: \"kubernetes.io/projected/a82b243a-767d-4ebd-8fb7-31164db854db-kube-api-access-66zfx\") pod \"node-exporter-9kqvg\" (UID: \"a82b243a-767d-4ebd-8fb7-31164db854db\") " pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.853687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:58.853657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kqvg"
Sep 10 10:35:58.866280 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:35:58.866254    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82b243a_767d_4ebd_8fb7_31164db854db.slice/crio-037d519365f7763437a55148294f946235b3a326ed13790b31c457abaebdee25 WatchSource:0}: Error finding container 037d519365f7763437a55148294f946235b3a326ed13790b31c457abaebdee25: Status 404 returned error can't find the container with id 037d519365f7763437a55148294f946235b3a326ed13790b31c457abaebdee25
Sep 10 10:35:59.301240 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.301198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqvg" event={"ID":"a82b243a-767d-4ebd-8fb7-31164db854db","Type":"ContainerStarted","Data":"037d519365f7763437a55148294f946235b3a326ed13790b31c457abaebdee25"}
Sep 10 10:35:59.592277 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.592201    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:35:59.595940 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.595916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.598769 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.598747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 10:35:59.598769 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.598761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 10:35:59.599093 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599074    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 10:35:59.599190 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599111    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 10:35:59.599190 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599154    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 10:35:59.599190 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599167    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 10:35:59.599340 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqb62\""
Sep 10 10:35:59.599340 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599215    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 10:35:59.599340 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 10:35:59.599340 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.599312    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 10:35:59.611249 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.611226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:35:59.688761 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.688761 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.688950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h69rr\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.688950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.688950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.688950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.688982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.689005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.689029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.689057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689270 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.689105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.689270 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.689161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790557 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790557 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:59.790697    2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.790801 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:59.790780    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls podName:3a2f9b66-da7f-48f2-a866-612149f73085 nodeName:}" failed. No retries permitted until 2026-09-10 10:36:00.290759275 +0000 UTC m=+78.858239878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085") : secret "alertmanager-main-tls" not found
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:35:59.790864    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle podName:3a2f9b66-da7f-48f2-a866-612149f73085 nodeName:}" failed. No retries permitted until 2026-09-10 10:36:00.29084272 +0000 UTC m=+78.858323319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085") : configmap references non-existent config key: ca-bundle.crt
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.790971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h69rr\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.791023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.791050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.791079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.791152 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.791133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.793786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.793855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794004    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794071    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794518 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794498    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.794897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.794690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.795739 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.795716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:35:59.804371 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:35:59.804322    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h69rr\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.294988 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.294905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.294988 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.294974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.295799 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.295775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.297229 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.297210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.306465 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.306437    2583 generic.go:356] "Generic (PLEG): container finished" podID="a82b243a-767d-4ebd-8fb7-31164db854db" containerID="79cc7412a322aad30989dced60c924fbe77a03203c58c5cd75c8ccb7f34eeb78" exitCode=0
Sep 10 10:36:00.306575 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.306484    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqvg" event={"ID":"a82b243a-767d-4ebd-8fb7-31164db854db","Type":"ContainerDied","Data":"79cc7412a322aad30989dced60c924fbe77a03203c58c5cd75c8ccb7f34eeb78"}
Sep 10 10:36:00.506721 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.506677    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:36:00.788274 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:00.788247    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:36:00.790057 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:36:00.790030    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2f9b66_da7f_48f2_a866_612149f73085.slice/crio-9e21ef3ea9303027ec4d9412eaaa7b52fbc22fc1bf16a094972b62c578e05142 WatchSource:0}: Error finding container 9e21ef3ea9303027ec4d9412eaaa7b52fbc22fc1bf16a094972b62c578e05142: Status 404 returned error can't find the container with id 9e21ef3ea9303027ec4d9412eaaa7b52fbc22fc1bf16a094972b62c578e05142
Sep 10 10:36:01.311727 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:01.311689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqvg" event={"ID":"a82b243a-767d-4ebd-8fb7-31164db854db","Type":"ContainerStarted","Data":"60fee5f6ca326fa704a3eec45346054f771174441461e199a7d12eda2d751e81"}
Sep 10 10:36:01.311927 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:01.311755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqvg" event={"ID":"a82b243a-767d-4ebd-8fb7-31164db854db","Type":"ContainerStarted","Data":"44a31ab27a6c502fe810029d973a60f1c455f632ad9b4342e701ef5932cea276"}
Sep 10 10:36:01.312897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:01.312871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"9e21ef3ea9303027ec4d9412eaaa7b52fbc22fc1bf16a094972b62c578e05142"}
Sep 10 10:36:01.334967 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:01.334922    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9kqvg" podStartSLOduration=2.211423528 podStartE2EDuration="3.334906911s" totalImagesPullingTime="1.063162967s" totalInitContainerRuntime="60.320416ms" isStatefulPod=true podCreationTimestamp="2026-09-10 10:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:01.333122927 +0000 UTC m=+79.900603564" watchObservedRunningTime="2026-09-10 10:36:01.334906911 +0000 UTC m=+79.902387527"
Sep 10 10:36:01.984083 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:36:01.984051    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2f9b66_da7f_48f2_a866_612149f73085.slice/crio-c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 10:36:02.317981 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:02.317950    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b" exitCode=0
Sep 10 10:36:02.318149 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:02.318036    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"}
Sep 10 10:36:03.696279 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.696242    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"]
Sep 10 10:36:03.700611 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.700574    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.703560 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.703532    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 10:36:03.703707 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.703688    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 10:36:03.703763 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.703722    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 10:36:03.703850 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.703834    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f9drn\""
Sep 10 10:36:03.703950 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.703919    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 10:36:03.704064 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.704010    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 10:36:03.708764 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.708741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 10:36:03.712633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.712611    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"]
Sep 10 10:36:03.820225 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820225 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ftt6\" (UniqueName: \"kubernetes.io/projected/42b911ee-da27-43f5-8957-97c68229cb35-kube-api-access-4ftt6\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-metrics-client-ca\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-federate-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.820619 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.820575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-serving-certs-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.921904 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.921873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922075 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.921914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-serving-certs-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922075 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.921932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922075 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922232 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ftt6\" (UniqueName: \"kubernetes.io/projected/42b911ee-da27-43f5-8957-97c68229cb35-kube-api-access-4ftt6\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922232 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-metrics-client-ca\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922232 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-federate-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922372 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922796 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-serving-certs-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922896 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-metrics-client-ca\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.922896 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.922879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.924856 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.924829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-telemeter-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.924971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.924925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.924971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.924929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-federate-client-tls\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.925086 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.925036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42b911ee-da27-43f5-8957-97c68229cb35-secret-telemeter-client\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:03.931427 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:03.931405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ftt6\" (UniqueName: \"kubernetes.io/projected/42b911ee-da27-43f5-8957-97c68229cb35-kube-api-access-4ftt6\") pod \"telemeter-client-5b9799f5d8-xdnnj\" (UID: \"42b911ee-da27-43f5-8957-97c68229cb35\") " pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:04.010047 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:04.009973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"
Sep 10 10:36:04.287731 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:04.287583    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j5d8r"
Sep 10 10:36:04.580344 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:04.580322    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj"]
Sep 10 10:36:04.582720 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:36:04.582641    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b911ee_da27_43f5_8957_97c68229cb35.slice/crio-02f9da9137df7c8083cfc400a0c5b59a7b774427e15beaf54e4ae682ab784c66 WatchSource:0}: Error finding container 02f9da9137df7c8083cfc400a0c5b59a7b774427e15beaf54e4ae682ab784c66: Status 404 returned error can't find the container with id 02f9da9137df7c8083cfc400a0c5b59a7b774427e15beaf54e4ae682ab784c66
Sep 10 10:36:05.290989 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.290959    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:05.294076 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.294056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.297488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297460    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 10:36:05.297488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297481    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 10:36:05.297655 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297622    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4vtj6\""
Sep 10 10:36:05.297655 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297640    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 10:36:05.297794 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297768    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 10:36:05.297903 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 10:36:05.297986 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.297904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 10:36:05.298107 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.298095    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 10:36:05.304686 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.304665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:05.334882 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.334837    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj" event={"ID":"42b911ee-da27-43f5-8957-97c68229cb35","Type":"ContainerStarted","Data":"02f9da9137df7c8083cfc400a0c5b59a7b774427e15beaf54e4ae682ab784c66"}
Sep 10 10:36:05.338084 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.338056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"}
Sep 10 10:36:05.338182 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.338110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"}
Sep 10 10:36:05.338182 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.338135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"}
Sep 10 10:36:05.338182 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.338158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"}
Sep 10 10:36:05.338182 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.338179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"}
Sep 10 10:36:05.434797 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.434797 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwn84\" (UniqueName: \"kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.435018 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.435018 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.435018 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.435018 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.434941    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535498 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535498 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535714 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535714 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535714 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.535714 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.535616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwn84\" (UniqueName: \"kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.536344 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.536316    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.536485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.536460    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.536586 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.536557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.538255 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.538234    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.538444 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.538424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.546512 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.546463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwn84\" (UniqueName: \"kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84\") pod \"console-5647447859-kz8gd\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") " pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.604427 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.604391    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:05.880202 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:05.880121    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:05.884267 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:36:05.884237    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc47a39_6008_44cb_9d7b_9b3657aaf5f7.slice/crio-6b77f51f069cdedb41954772359551732c64252e075208e10665c9d84dd2c0a8 WatchSource:0}: Error finding container 6b77f51f069cdedb41954772359551732c64252e075208e10665c9d84dd2c0a8: Status 404 returned error can't find the container with id 6b77f51f069cdedb41954772359551732c64252e075208e10665c9d84dd2c0a8
Sep 10 10:36:06.343914 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:06.343868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647447859-kz8gd" event={"ID":"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7","Type":"ContainerStarted","Data":"6b77f51f069cdedb41954772359551732c64252e075208e10665c9d84dd2c0a8"}
Sep 10 10:36:06.348171 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:06.348140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerStarted","Data":"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"}
Sep 10 10:36:06.380175 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:06.380121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.583648218 podStartE2EDuration="7.380092705s" totalImagesPullingTime="3.781157916s" totalInitContainerRuntime="15.286571ms" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:06.377791258 +0000 UTC m=+84.945271894" watchObservedRunningTime="2026-09-10 10:36:06.380092705 +0000 UTC m=+84.947573320"
Sep 10 10:36:07.354874 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:07.354838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj" event={"ID":"42b911ee-da27-43f5-8957-97c68229cb35","Type":"ContainerStarted","Data":"92aae425ea4dff3a9c40102a258db1688d646c25fc8a4c47d809890f2ba9bd01"}
Sep 10 10:36:07.355343 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:07.354903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj" event={"ID":"42b911ee-da27-43f5-8957-97c68229cb35","Type":"ContainerStarted","Data":"214b9cdf83dd7625457ddb3cad6b0bae7c4cd349ba710dba4c3a0980500bab19"}
Sep 10 10:36:07.355343 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:07.354936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj" event={"ID":"42b911ee-da27-43f5-8957-97c68229cb35","Type":"ContainerStarted","Data":"f48b87f79aa17aef7ce83a2de8cad304b4734534b800cde87352022d29ad5424"}
Sep 10 10:36:07.380647 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:07.380583    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b9799f5d8-xdnnj" podStartSLOduration=2.3020887820000002 podStartE2EDuration="4.380561628s" totalImagesPullingTime="2.078472846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:07.378132462 +0000 UTC m=+85.945613128" watchObservedRunningTime="2026-09-10 10:36:07.380561628 +0000 UTC m=+85.948042244"
Sep 10 10:36:09.365260 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:09.365223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647447859-kz8gd" event={"ID":"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7","Type":"ContainerStarted","Data":"e13bd566d6cdc0bf2a76391233bcdb6002b02e05de3dbc4778f3151e03a6824e"}
Sep 10 10:36:09.386165 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:09.386081    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5647447859-kz8gd" podStartSLOduration=1.13560002 podStartE2EDuration="4.386066106s" totalImagesPullingTime="3.250466086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:09.385410723 +0000 UTC m=+87.952891348" watchObservedRunningTime="2026-09-10 10:36:09.386066106 +0000 UTC m=+87.953546753"
Sep 10 10:36:15.605071 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:15.605023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:15.605470 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:15.605090    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:15.609674 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:15.609655    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:16.394850 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:16.394822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:24.364948 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:24.364910    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:26.291024 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:26.290984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-txgnh"
Sep 10 10:36:49.384576 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.384512    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5647447859-kz8gd" podUID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" containerName="console" containerID="cri-o://e13bd566d6cdc0bf2a76391233bcdb6002b02e05de3dbc4778f3151e03a6824e" gracePeriod=15
Sep 10 10:36:49.513039 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.512993    2583 generic.go:356] "Generic (PLEG): container finished" podID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" containerID="e13bd566d6cdc0bf2a76391233bcdb6002b02e05de3dbc4778f3151e03a6824e" exitCode=0
Sep 10 10:36:49.513193 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.513074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647447859-kz8gd" event={"ID":"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7","Type":"ContainerDied","Data":"e13bd566d6cdc0bf2a76391233bcdb6002b02e05de3dbc4778f3151e03a6824e"}
Sep 10 10:36:49.666827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.666803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:49.798965 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.798909    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799181 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwn84\" (UniqueName: \"kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799181 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799091    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799181 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799181 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799152    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799408 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert\") pod \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\" (UID: \"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7\") "
Sep 10 10:36:49.799547 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799510    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:36:49.799651 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799627    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config" (OuterVolumeSpecName: "console-config") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:36:49.799747 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.799718    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:36:49.801498 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.801458    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:36:49.801599 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.801519    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:36:49.801599 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.801530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84" (OuterVolumeSpecName: "kube-api-access-nwn84") pod "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" (UID: "ccc47a39-6008-44cb-9d7b-9b3657aaf5f7"). InnerVolumeSpecName "kube-api-access-nwn84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900310    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-oauth-serving-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900350    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-service-ca\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900361    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwn84\" (UniqueName: \"kubernetes.io/projected/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-kube-api-access-nwn84\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900370    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900395    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-serving-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:49.900423 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:49.900403    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7-console-oauth-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:36:50.518717 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:50.518679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647447859-kz8gd" event={"ID":"ccc47a39-6008-44cb-9d7b-9b3657aaf5f7","Type":"ContainerDied","Data":"6b77f51f069cdedb41954772359551732c64252e075208e10665c9d84dd2c0a8"}
Sep 10 10:36:50.519123 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:50.518688    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647447859-kz8gd"
Sep 10 10:36:50.519473 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:50.519454    2583 scope.go:117] "RemoveContainer" containerID="e13bd566d6cdc0bf2a76391233bcdb6002b02e05de3dbc4778f3151e03a6824e"
Sep 10 10:36:50.536231 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:50.536208    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:50.540275 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:50.540254    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5647447859-kz8gd"]
Sep 10 10:36:51.918761 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:36:51.918731    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" path="/var/lib/kubelet/pods/ccc47a39-6008-44cb-9d7b-9b3657aaf5f7/volumes"
Sep 10 10:37:15.955063 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.955032    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:37:15.955465 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.955282    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" containerName="console"
Sep 10 10:37:15.955465 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.955293    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" containerName="console"
Sep 10 10:37:15.955465 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.955346    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc47a39-6008-44cb-9d7b-9b3657aaf5f7" containerName="console"
Sep 10 10:37:15.958444 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.958423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:15.962524 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.962505    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 10:37:15.963189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.963175    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 10:37:15.963710 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.963689    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4vtj6\""
Sep 10 10:37:15.963818 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.963715    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 10:37:15.963975 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.963959    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 10:37:15.964151 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.964135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 10:37:15.964228 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.964154    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 10:37:15.964735 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.964558    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 10:37:15.969786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.969766    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 10:37:15.972008 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:15.971990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:37:16.101540 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101540 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101785 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101785 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101785 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101785 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqqq\" (UniqueName: \"kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.101942 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.101797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.202787 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.202879 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.202879 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.202879 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.202879 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203041 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqqq\" (UniqueName: \"kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203041 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.202920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203700 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.203672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203842 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.203820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203902 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.203818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.203902 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.203866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.205432 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.205370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.205513 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.205469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.215875 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.215856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqqq\" (UniqueName: \"kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq\") pod \"console-f44f797d7-bn6pt\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") " pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.267715 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.267673    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:16.541611 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.541531    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:37:16.544875 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:37:16.544849    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074a0443_7e40_41e6_a4a0_2d684c537f82.slice/crio-b5e5e50311bdb4f53125af2d1f8de7112a4ab782cd3e10255c49b4132d6ccb4f WatchSource:0}: Error finding container b5e5e50311bdb4f53125af2d1f8de7112a4ab782cd3e10255c49b4132d6ccb4f: Status 404 returned error can't find the container with id b5e5e50311bdb4f53125af2d1f8de7112a4ab782cd3e10255c49b4132d6ccb4f
Sep 10 10:37:16.612632 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.612602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f44f797d7-bn6pt" event={"ID":"074a0443-7e40-41e6-a4a0-2d684c537f82","Type":"ContainerStarted","Data":"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"}
Sep 10 10:37:16.612755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.612650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f44f797d7-bn6pt" event={"ID":"074a0443-7e40-41e6-a4a0-2d684c537f82","Type":"ContainerStarted","Data":"b5e5e50311bdb4f53125af2d1f8de7112a4ab782cd3e10255c49b4132d6ccb4f"}
Sep 10 10:37:16.637967 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:16.637899    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f44f797d7-bn6pt" podStartSLOduration=1.637878247 podStartE2EDuration="1.637878247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:37:16.636323632 +0000 UTC m=+155.203804269" watchObservedRunningTime="2026-09-10 10:37:16.637878247 +0000 UTC m=+155.205358865"
Sep 10 10:37:18.982959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.982924    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:18.983332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983204    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="alertmanager" containerID="cri-o://a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914" gracePeriod=120
Sep 10 10:37:18.983332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983269    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-metric" containerID="cri-o://4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25" gracePeriod=120
Sep 10 10:37:18.983482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983309    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="prom-label-proxy" containerID="cri-o://3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2" gracePeriod=120
Sep 10 10:37:18.983482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983356    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="config-reloader" containerID="cri-o://fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3" gracePeriod=120
Sep 10 10:37:18.983482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983410    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy" containerID="cri-o://26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5" gracePeriod=120
Sep 10 10:37:18.983482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:18.983344    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-web" containerID="cri-o://84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648" gracePeriod=120
Sep 10 10:37:19.626674 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626639    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2" exitCode=0
Sep 10 10:37:19.626674 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626668    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5" exitCode=0
Sep 10 10:37:19.626674 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626677    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3" exitCode=0
Sep 10 10:37:19.626674 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626685    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914" exitCode=0
Sep 10 10:37:19.626970 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"}
Sep 10 10:37:19.626970 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"}
Sep 10 10:37:19.626970 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"}
Sep 10 10:37:19.626970 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:19.626823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"}
Sep 10 10:37:20.225690 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.225666    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.330078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.329991    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330078 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330055    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330124    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h69rr\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330218    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330293 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330249    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330630 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330304    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330630 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330330    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.330630 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.330361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.331485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.331485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331086    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume\") pod \"3a2f9b66-da7f-48f2-a866-612149f73085\" (UID: \"3a2f9b66-da7f-48f2-a866-612149f73085\") "
Sep 10 10:37:20.331485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331215    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:37:20.331485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331354    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-metrics-client-ca\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.331485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:37:20.331815 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.331601    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:37:20.333516 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.333476    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.333611 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.333551    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.333744 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.333664    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr" (OuterVolumeSpecName: "kube-api-access-h69rr") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "kube-api-access-h69rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:37:20.334071 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.334036    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.334241 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.334219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume" (OuterVolumeSpecName: "config-volume") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.334357 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.334236    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out" (OuterVolumeSpecName: "config-out") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:37:20.334695 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.334676    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.335053 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.335034    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:37:20.337413 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.337263    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.343333 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.343312    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config" (OuterVolumeSpecName: "web-config") pod "3a2f9b66-da7f-48f2-a866-612149f73085" (UID: "3a2f9b66-da7f-48f2-a866-612149f73085"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:37:20.432671 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432628    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432671 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432661    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-config-out\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432671 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432671    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-config-volume\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432671 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432680    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432694    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-web-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432702    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-cluster-tls-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432711    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-main-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432719    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432728    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h69rr\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-kube-api-access-h69rr\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432737    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a2f9b66-da7f-48f2-a866-612149f73085-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432745    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a2f9b66-da7f-48f2-a866-612149f73085-alertmanager-main-db\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.432917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.432752    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a2f9b66-da7f-48f2-a866-612149f73085-tls-assets\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:37:20.633444 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633353    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25" exitCode=0
Sep 10 10:37:20.633444 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633400    2583 generic.go:356] "Generic (PLEG): container finished" podID="3a2f9b66-da7f-48f2-a866-612149f73085" containerID="84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648" exitCode=0
Sep 10 10:37:20.633600 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633444    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.633600 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"}
Sep 10 10:37:20.633600 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"}
Sep 10 10:37:20.633694 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a2f9b66-da7f-48f2-a866-612149f73085","Type":"ContainerDied","Data":"9e21ef3ea9303027ec4d9412eaaa7b52fbc22fc1bf16a094972b62c578e05142"}
Sep 10 10:37:20.633694 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.633643    2583 scope.go:117] "RemoveContainer" containerID="3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"
Sep 10 10:37:20.644330 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.643973    2583 scope.go:117] "RemoveContainer" containerID="4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"
Sep 10 10:37:20.651469 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.651450    2583 scope.go:117] "RemoveContainer" containerID="26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"
Sep 10 10:37:20.658019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.658002    2583 scope.go:117] "RemoveContainer" containerID="84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"
Sep 10 10:37:20.662505 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.662481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:20.665000 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.664979    2583 scope.go:117] "RemoveContainer" containerID="fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"
Sep 10 10:37:20.669554 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.669529    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:20.672335 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.672320    2583 scope.go:117] "RemoveContainer" containerID="a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"
Sep 10 10:37:20.679114 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.679096    2583 scope.go:117] "RemoveContainer" containerID="c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"
Sep 10 10:37:20.685707 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.685689    2583 scope.go:117] "RemoveContainer" containerID="3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"
Sep 10 10:37:20.685967 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.685948    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2\": container with ID starting with 3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2 not found: ID does not exist" containerID="3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"
Sep 10 10:37:20.686011 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.685976    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"} err="failed to get container status \"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2\": rpc error: code = NotFound desc = could not find container \"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2\": container with ID starting with 3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2 not found: ID does not exist"
Sep 10 10:37:20.686011 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686009    2583 scope.go:117] "RemoveContainer" containerID="4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"
Sep 10 10:37:20.686252 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.686237    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25\": container with ID starting with 4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25 not found: ID does not exist" containerID="4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"
Sep 10 10:37:20.686291 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686256    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"} err="failed to get container status \"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25\": rpc error: code = NotFound desc = could not find container \"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25\": container with ID starting with 4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25 not found: ID does not exist"
Sep 10 10:37:20.686291 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686270    2583 scope.go:117] "RemoveContainer" containerID="26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"
Sep 10 10:37:20.686517 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.686498    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5\": container with ID starting with 26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5 not found: ID does not exist" containerID="26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"
Sep 10 10:37:20.686554 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686523    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"} err="failed to get container status \"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5\": rpc error: code = NotFound desc = could not find container \"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5\": container with ID starting with 26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5 not found: ID does not exist"
Sep 10 10:37:20.686554 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686539    2583 scope.go:117] "RemoveContainer" containerID="84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"
Sep 10 10:37:20.686776 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.686759    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648\": container with ID starting with 84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648 not found: ID does not exist" containerID="84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"
Sep 10 10:37:20.686826 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686780    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"} err="failed to get container status \"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648\": rpc error: code = NotFound desc = could not find container \"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648\": container with ID starting with 84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648 not found: ID does not exist"
Sep 10 10:37:20.686826 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.686793    2583 scope.go:117] "RemoveContainer" containerID="fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"
Sep 10 10:37:20.687018 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.687004    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3\": container with ID starting with fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3 not found: ID does not exist" containerID="fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"
Sep 10 10:37:20.687060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687021    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"} err="failed to get container status \"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3\": rpc error: code = NotFound desc = could not find container \"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3\": container with ID starting with fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3 not found: ID does not exist"
Sep 10 10:37:20.687060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687031    2583 scope.go:117] "RemoveContainer" containerID="a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"
Sep 10 10:37:20.687221 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.687207    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914\": container with ID starting with a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914 not found: ID does not exist" containerID="a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"
Sep 10 10:37:20.687259 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687224    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"} err="failed to get container status \"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914\": rpc error: code = NotFound desc = could not find container \"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914\": container with ID starting with a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914 not found: ID does not exist"
Sep 10 10:37:20.687259 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687234    2583 scope.go:117] "RemoveContainer" containerID="c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"
Sep 10 10:37:20.687500 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:37:20.687481    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b\": container with ID starting with c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b not found: ID does not exist" containerID="c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"
Sep 10 10:37:20.687575 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687501    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"} err="failed to get container status \"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b\": rpc error: code = NotFound desc = could not find container \"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b\": container with ID starting with c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b not found: ID does not exist"
Sep 10 10:37:20.687575 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687511    2583 scope.go:117] "RemoveContainer" containerID="3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"
Sep 10 10:37:20.687695 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687677    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2"} err="failed to get container status \"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2\": rpc error: code = NotFound desc = could not find container \"3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2\": container with ID starting with 3242ca9167b8bd323a5f331dcf53bb677ca20a0c4c1ff1355723f82fad6e0fb2 not found: ID does not exist"
Sep 10 10:37:20.687695 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687693    2583 scope.go:117] "RemoveContainer" containerID="4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"
Sep 10 10:37:20.687927 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687909    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25"} err="failed to get container status \"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25\": rpc error: code = NotFound desc = could not find container \"4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25\": container with ID starting with 4550c7e4ede1be90129e82f35f9ae6052264c8e87d4a419badd94de9bb9cfa25 not found: ID does not exist"
Sep 10 10:37:20.687974 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.687928    2583 scope.go:117] "RemoveContainer" containerID="26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"
Sep 10 10:37:20.688130 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688111    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5"} err="failed to get container status \"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5\": rpc error: code = NotFound desc = could not find container \"26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5\": container with ID starting with 26f4a9b3bdbf736a03ae23a26cfd0acc5dc725d0f42b7b93759053598d396ad5 not found: ID does not exist"
Sep 10 10:37:20.688194 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688133    2583 scope.go:117] "RemoveContainer" containerID="84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"
Sep 10 10:37:20.688396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688364    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648"} err="failed to get container status \"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648\": rpc error: code = NotFound desc = could not find container \"84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648\": container with ID starting with 84e1281a08f75d04dd9f0ce6b2cf3473292ba68dbef15abe9e54fc93cccf3648 not found: ID does not exist"
Sep 10 10:37:20.688396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688393    2583 scope.go:117] "RemoveContainer" containerID="fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"
Sep 10 10:37:20.688608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688588    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3"} err="failed to get container status \"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3\": rpc error: code = NotFound desc = could not find container \"fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3\": container with ID starting with fb5a91b85b5b640dc272a835b5fb18f3618b17cf8a16dd514d106c4f635ee4e3 not found: ID does not exist"
Sep 10 10:37:20.688647 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688609    2583 scope.go:117] "RemoveContainer" containerID="a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"
Sep 10 10:37:20.688825 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688807    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914"} err="failed to get container status \"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914\": rpc error: code = NotFound desc = could not find container \"a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914\": container with ID starting with a5b06dd3593847f6c82df9607d15aa537ec349ced0737fc2d04c90a47b654914 not found: ID does not exist"
Sep 10 10:37:20.688889 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.688827    2583 scope.go:117] "RemoveContainer" containerID="c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"
Sep 10 10:37:20.689039 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.689024    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b"} err="failed to get container status \"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b\": rpc error: code = NotFound desc = could not find container \"c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b\": container with ID starting with c17378d2405eca8545fc100606465f0ffa3021230fc85f7eacc1a020f5380a0b not found: ID does not exist"
Sep 10 10:37:20.721892 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.721861    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:20.722158 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722146    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-metric"
Sep 10 10:37:20.722200 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722160    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-metric"
Sep 10 10:37:20.722200 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722169    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="config-reloader"
Sep 10 10:37:20.722200 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722175    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="config-reloader"
Sep 10 10:37:20.722200 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722186    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-web"
Sep 10 10:37:20.722200 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722195    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-web"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722209    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="alertmanager"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722216    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="alertmanager"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722222    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="prom-label-proxy"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722228    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="prom-label-proxy"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722235    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722240    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722250    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="init-config-reloader"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722255    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="init-config-reloader"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722302    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-metric"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722310    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="alertmanager"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722316    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722321    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="config-reloader"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722326    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="kube-rbac-proxy-web"
Sep 10 10:37:20.722338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.722331    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" containerName="prom-label-proxy"
Sep 10 10:37:20.727283 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.727266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.730005 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.729982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 10:37:20.731353 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 10:37:20.731353 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731343    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 10:37:20.731503 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731365    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 10:37:20.731746 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731727    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqb62\""
Sep 10 10:37:20.731919 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731903    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 10:37:20.731970 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.731941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 10:37:20.732089 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.732074    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 10:37:20.732521 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.732505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 10:37:20.736537 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.736517    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 10:37:20.749235 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.749208    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:20.835303 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835475 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8tpn\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-kube-api-access-t8tpn\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835475 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-config-out\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835475 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-web-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835475 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835475 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.835680 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.835620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936325 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-web-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936535 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936535 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936535 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936535 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936738 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936738 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936738 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936738 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8tpn\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-kube-api-access-t8tpn\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.936946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.936871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-config-out\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.937326 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.937302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939472 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-config-out\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939584 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-web-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939645 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.939908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.940061 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.940061 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.939941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.940061 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.940000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a5a0987-1740-45e0-ad38-5df46c444551-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.940552 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.940533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a5a0987-1740-45e0-ad38-5df46c444551-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.941374 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.941358    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:20.949315 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:20.949300    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8tpn\" (UniqueName: \"kubernetes.io/projected/0a5a0987-1740-45e0-ad38-5df46c444551-kube-api-access-t8tpn\") pod \"alertmanager-main-0\" (UID: \"0a5a0987-1740-45e0-ad38-5df46c444551\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:21.036570 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.036537    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 10:37:21.315750 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.315666    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 10:37:21.319511 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:37:21.319485    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a5a0987_1740_45e0_ad38_5df46c444551.slice/crio-4e39bfcd4847c80254b86753e7780dfab2bd826a79c7f40a5ffbd97d97f67b98 WatchSource:0}: Error finding container 4e39bfcd4847c80254b86753e7780dfab2bd826a79c7f40a5ffbd97d97f67b98: Status 404 returned error can't find the container with id 4e39bfcd4847c80254b86753e7780dfab2bd826a79c7f40a5ffbd97d97f67b98
Sep 10 10:37:21.638404 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.638305    2583 generic.go:356] "Generic (PLEG): container finished" podID="0a5a0987-1740-45e0-ad38-5df46c444551" containerID="89bf1ca848c3c4e39928041f6249547aeb996abf3ef4d1b239dcf505e61fdf4b" exitCode=0
Sep 10 10:37:21.638565 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.638416    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerDied","Data":"89bf1ca848c3c4e39928041f6249547aeb996abf3ef4d1b239dcf505e61fdf4b"}
Sep 10 10:37:21.638565 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.638497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"4e39bfcd4847c80254b86753e7780dfab2bd826a79c7f40a5ffbd97d97f67b98"}
Sep 10 10:37:21.923426 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:21.923395    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a2f9b66-da7f-48f2-a866-612149f73085" path="/var/lib/kubelet/pods/3a2f9b66-da7f-48f2-a866-612149f73085/volumes"
Sep 10 10:37:22.646345 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"4e3219f59123a76e50f3f455c2c9141201b8218a9e0c090b22686a0c1767af44"}
Sep 10 10:37:22.646755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"d7d25a85a57514bae69658c87f6f70f5dca00908706d08d88c4739667e649338"}
Sep 10 10:37:22.646755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"7a5313ef012cb4d82ae7a7903d4cef2c2ba3d3a74caff8bf398f9694a58770b3"}
Sep 10 10:37:22.646755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646452    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"b36b3404dec74146cb32bc138d74bf78b5ccc88b7e00d82440b988232f53a36f"}
Sep 10 10:37:22.646755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"c3f56865189484c9d44e049904826d5e08374e68729f6e899110c59f6d6313aa"}
Sep 10 10:37:22.646755 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.646499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a5a0987-1740-45e0-ad38-5df46c444551","Type":"ContainerStarted","Data":"adcc577dd92f91a1856b73923a0c3f2334d508cec6ac1637c6f78575536abad5"}
Sep 10 10:37:22.676122 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:22.676068    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6609637299999997 podStartE2EDuration="2.676045631s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.081901ms" isStatefulPod=false podCreationTimestamp="2026-09-10 10:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:37:22.673793621 +0000 UTC m=+161.241274287" watchObservedRunningTime="2026-09-10 10:37:22.676045631 +0000 UTC m=+161.243526248"
Sep 10 10:37:26.268053 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:26.268018    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:26.268426 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:26.268080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:26.272780 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:26.272761    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:37:26.665159 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:37:26.665073    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:39:41.790927 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:39:41.790896    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:39:41.793683 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:39:41.793658    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:39:41.795409 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:39:41.795357    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 10:41:06.798357 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.798282    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-849d646b67-87psm"]
Sep 10 10:41:06.801225 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.801209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.812996 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.812968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849d646b67-87psm"]
Sep 10 10:41:06.893947 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.893914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-console-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.893947 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.893950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.894162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.893989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-oauth-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.894162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.894007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-trusted-ca-bundle\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.894162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.894021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-oauth-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.894162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.894038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8rm\" (UniqueName: \"kubernetes.io/projected/84388eb9-e40a-451b-9b00-792e0ee3586b-kube-api-access-sh8rm\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.894162 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.894113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-service-ca\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994696 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-oauth-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994696 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-trusted-ca-bundle\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-oauth-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8rm\" (UniqueName: \"kubernetes.io/projected/84388eb9-e40a-451b-9b00-792e0ee3586b-kube-api-access-sh8rm\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-service-ca\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.994917 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-console-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.995085 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.994975    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.995610 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.995585    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-service-ca\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.995740 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.995690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-console-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.995740 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.995689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-trusted-ca-bundle\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.995740 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.995695    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84388eb9-e40a-451b-9b00-792e0ee3586b-oauth-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.997241 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.997212    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-oauth-config\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:06.997337 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:06.997310    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84388eb9-e40a-451b-9b00-792e0ee3586b-console-serving-cert\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:07.002453 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:07.002429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8rm\" (UniqueName: \"kubernetes.io/projected/84388eb9-e40a-451b-9b00-792e0ee3586b-kube-api-access-sh8rm\") pod \"console-849d646b67-87psm\" (UID: \"84388eb9-e40a-451b-9b00-792e0ee3586b\") " pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:07.110595 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:07.110492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:07.381140 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:07.381060    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849d646b67-87psm"]
Sep 10 10:41:07.383860 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:41:07.383834    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84388eb9_e40a_451b_9b00_792e0ee3586b.slice/crio-a7b18473f251d829a26418ea44caf654cb608803f3a429051ce4d163ab207ede WatchSource:0}: Error finding container a7b18473f251d829a26418ea44caf654cb608803f3a429051ce4d163ab207ede: Status 404 returned error can't find the container with id a7b18473f251d829a26418ea44caf654cb608803f3a429051ce4d163ab207ede
Sep 10 10:41:07.441325 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:07.441297    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849d646b67-87psm" event={"ID":"84388eb9-e40a-451b-9b00-792e0ee3586b","Type":"ContainerStarted","Data":"a7b18473f251d829a26418ea44caf654cb608803f3a429051ce4d163ab207ede"}
Sep 10 10:41:08.445955 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:08.445920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849d646b67-87psm" event={"ID":"84388eb9-e40a-451b-9b00-792e0ee3586b","Type":"ContainerStarted","Data":"82db826e19e028683d91212d4e54e4af51ee6cf5bd333386761eac66114f1ce7"}
Sep 10 10:41:08.469797 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:08.469743    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-849d646b67-87psm" podStartSLOduration=2.4697263769999998 podStartE2EDuration="2.469726377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:41:08.468521966 +0000 UTC m=+387.036002601" watchObservedRunningTime="2026-09-10 10:41:08.469726377 +0000 UTC m=+387.037206992"
Sep 10 10:41:17.111625 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:17.111584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:17.111992 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:17.111680    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:17.116285 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:17.116264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:17.482998 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:17.482970    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-849d646b67-87psm"
Sep 10 10:41:17.534843 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:17.534811    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:41:42.559357 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.559314    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f44f797d7-bn6pt" podUID="074a0443-7e40-41e6-a4a0-2d684c537f82" containerName="console" containerID="cri-o://21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d" gracePeriod=15
Sep 10 10:41:42.799502 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.799476    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:41:42.885884 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.885799    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886029 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.885897    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886029 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.885944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkqqq\" (UniqueName: \"kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886029 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.885980    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886029 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886021    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886217 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886081    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886217 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886111    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config\") pod \"074a0443-7e40-41e6-a4a0-2d684c537f82\" (UID: \"074a0443-7e40-41e6-a4a0-2d684c537f82\") "
Sep 10 10:41:42.886217 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config" (OuterVolumeSpecName: "console-config") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:41:42.886371 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886336    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-console-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.886460 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886365    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca" (OuterVolumeSpecName: "service-ca") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:41:42.886513 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886486    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:41:42.886708 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.886684    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:41:42.888178 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.888150    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:41:42.888178 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.888169    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:41:42.888312 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.888171    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq" (OuterVolumeSpecName: "kube-api-access-zkqqq") pod "074a0443-7e40-41e6-a4a0-2d684c537f82" (UID: "074a0443-7e40-41e6-a4a0-2d684c537f82"). InnerVolumeSpecName "kube-api-access-zkqqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:41:42.987470 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987431    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-oauth-serving-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.987470 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987462    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-oauth-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.987470 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987471    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-service-ca\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.987470 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987480    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkqqq\" (UniqueName: \"kubernetes.io/projected/074a0443-7e40-41e6-a4a0-2d684c537f82-kube-api-access-zkqqq\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.987718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987490    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/074a0443-7e40-41e6-a4a0-2d684c537f82-trusted-ca-bundle\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:42.987718 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:42.987498    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/074a0443-7e40-41e6-a4a0-2d684c537f82-console-serving-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:41:43.573479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.573438    2583 generic.go:356] "Generic (PLEG): container finished" podID="074a0443-7e40-41e6-a4a0-2d684c537f82" containerID="21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d" exitCode=0
Sep 10 10:41:43.573885 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.573503    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f44f797d7-bn6pt"
Sep 10 10:41:43.573885 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.573509    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f44f797d7-bn6pt" event={"ID":"074a0443-7e40-41e6-a4a0-2d684c537f82","Type":"ContainerDied","Data":"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"}
Sep 10 10:41:43.573885 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.573588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f44f797d7-bn6pt" event={"ID":"074a0443-7e40-41e6-a4a0-2d684c537f82","Type":"ContainerDied","Data":"b5e5e50311bdb4f53125af2d1f8de7112a4ab782cd3e10255c49b4132d6ccb4f"}
Sep 10 10:41:43.573885 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.573615    2583 scope.go:117] "RemoveContainer" containerID="21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"
Sep 10 10:41:43.582431 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.582413    2583 scope.go:117] "RemoveContainer" containerID="21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"
Sep 10 10:41:43.582683 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:41:43.582664    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d\": container with ID starting with 21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d not found: ID does not exist" containerID="21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"
Sep 10 10:41:43.582727 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.582693    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d"} err="failed to get container status \"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d\": rpc error: code = NotFound desc = could not find container \"21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d\": container with ID starting with 21fdf6a308b3c6eea638dcd1f307b0c3af1949f3910dd54fcb74fd663251e89d not found: ID does not exist"
Sep 10 10:41:43.597313 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.597289    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:41:43.601342 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.601317    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f44f797d7-bn6pt"]
Sep 10 10:41:43.919068 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:41:43.918989    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="074a0443-7e40-41e6-a4a0-2d684c537f82" path="/var/lib/kubelet/pods/074a0443-7e40-41e6-a4a0-2d684c537f82/volumes"
Sep 10 10:44:41.814958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:44:41.814931    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:44:41.816474 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:44:41.816448    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:45:40.755713 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.755680    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:45:40.756118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.755963    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074a0443-7e40-41e6-a4a0-2d684c537f82" containerName="console"
Sep 10 10:45:40.756118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.755976    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="074a0443-7e40-41e6-a4a0-2d684c537f82" containerName="console"
Sep 10 10:45:40.756118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.756033    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="074a0443-7e40-41e6-a4a0-2d684c537f82" containerName="console"
Sep 10 10:45:40.758750 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.758735    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:45:40.761073 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.761047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 10 10:45:40.761778 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.761761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-wch7j\""
Sep 10 10:45:40.761834 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.761761    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 10 10:45:40.765153 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.765130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:45:40.836056 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.836015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmjq\" (UniqueName: \"kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq\") pod \"redis-69bbd798b6-zf44c\" (UID: \"27318d51-8d99-4aa2-98b6-d33ed815aefe\") " pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:45:40.937079 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.937038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmjq\" (UniqueName: \"kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq\") pod \"redis-69bbd798b6-zf44c\" (UID: \"27318d51-8d99-4aa2-98b6-d33ed815aefe\") " pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:45:40.945702 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:40.945677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmjq\" (UniqueName: \"kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq\") pod \"redis-69bbd798b6-zf44c\" (UID: \"27318d51-8d99-4aa2-98b6-d33ed815aefe\") " pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:45:41.067796 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:41.067712    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:45:41.338111 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:41.338036    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:45:41.341097 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:45:41.341057    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27318d51_8d99_4aa2_98b6_d33ed815aefe.slice/crio-c703aa407da05586686e2f91eda4c52a7b64ff71b91a282fa15850e3fd8e876d WatchSource:0}: Error finding container c703aa407da05586686e2f91eda4c52a7b64ff71b91a282fa15850e3fd8e876d: Status 404 returned error can't find the container with id c703aa407da05586686e2f91eda4c52a7b64ff71b91a282fa15850e3fd8e876d
Sep 10 10:45:41.342897 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:41.342881    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 10:45:41.408827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:41.408796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-zf44c" event={"ID":"27318d51-8d99-4aa2-98b6-d33ed815aefe","Type":"ContainerStarted","Data":"c703aa407da05586686e2f91eda4c52a7b64ff71b91a282fa15850e3fd8e876d"}
Sep 10 10:45:43.418844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:43.418758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-zf44c" event={"ID":"27318d51-8d99-4aa2-98b6-d33ed815aefe","Type":"ContainerStarted","Data":"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"}
Sep 10 10:45:43.433287 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:45:43.433243    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-zf44c" podStartSLOduration=1.723808912 podStartE2EDuration="3.433229363s" totalImagesPullingTime="1.709420451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:45:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:45:43.433196652 +0000 UTC m=+662.000677289" watchObservedRunningTime="2026-09-10 10:45:43.433229363 +0000 UTC m=+662.000709979"
Sep 10 10:47:31.552637 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.552602    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:47:31.553128 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.552787    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-zf44c" podUID="27318d51-8d99-4aa2-98b6-d33ed815aefe" containerName="redis" containerID="cri-o://01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62" gracePeriod=30
Sep 10 10:47:31.790879 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.790856    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:47:31.802929 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.802877    2583 generic.go:356] "Generic (PLEG): container finished" podID="27318d51-8d99-4aa2-98b6-d33ed815aefe" containerID="01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62" exitCode=0
Sep 10 10:47:31.802929 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.802906    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-zf44c"
Sep 10 10:47:31.803060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.802961    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-zf44c" event={"ID":"27318d51-8d99-4aa2-98b6-d33ed815aefe","Type":"ContainerDied","Data":"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"}
Sep 10 10:47:31.803060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.803001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-zf44c" event={"ID":"27318d51-8d99-4aa2-98b6-d33ed815aefe","Type":"ContainerDied","Data":"c703aa407da05586686e2f91eda4c52a7b64ff71b91a282fa15850e3fd8e876d"}
Sep 10 10:47:31.803060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.803017    2583 scope.go:117] "RemoveContainer" containerID="01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"
Sep 10 10:47:31.811683 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.811663    2583 scope.go:117] "RemoveContainer" containerID="01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"
Sep 10 10:47:31.812115 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:47:31.812095    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62\": container with ID starting with 01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62 not found: ID does not exist" containerID="01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"
Sep 10 10:47:31.812209 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.812123    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62"} err="failed to get container status \"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62\": rpc error: code = NotFound desc = could not find container \"01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62\": container with ID starting with 01d8f16a1b22c04f40935d7aeecabf7e42f2d17a9314ffaea23aad0ad91e6d62 not found: ID does not exist"
Sep 10 10:47:31.867539 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.867506    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rmjq\" (UniqueName: \"kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq\") pod \"27318d51-8d99-4aa2-98b6-d33ed815aefe\" (UID: \"27318d51-8d99-4aa2-98b6-d33ed815aefe\") "
Sep 10 10:47:31.869457 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.869434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq" (OuterVolumeSpecName: "kube-api-access-8rmjq") pod "27318d51-8d99-4aa2-98b6-d33ed815aefe" (UID: "27318d51-8d99-4aa2-98b6-d33ed815aefe"). InnerVolumeSpecName "kube-api-access-8rmjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:47:31.968075 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:31.968045    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rmjq\" (UniqueName: \"kubernetes.io/projected/27318d51-8d99-4aa2-98b6-d33ed815aefe-kube-api-access-8rmjq\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:47:32.117884 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:32.117812    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:47:32.121463 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:32.121440    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-zf44c"]
Sep 10 10:47:33.918835 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:47:33.918800    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27318d51-8d99-4aa2-98b6-d33ed815aefe" path="/var/lib/kubelet/pods/27318d51-8d99-4aa2-98b6-d33ed815aefe/volumes"
Sep 10 10:49:41.838255 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:49:41.838189    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:49:41.838736 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:49:41.838436    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:52:46.895833 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.895796    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:52:46.896265 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.896069    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27318d51-8d99-4aa2-98b6-d33ed815aefe" containerName="redis"
Sep 10 10:52:46.896265 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.896081    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27318d51-8d99-4aa2-98b6-d33ed815aefe" containerName="redis"
Sep 10 10:52:46.896265 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.896155    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27318d51-8d99-4aa2-98b6-d33ed815aefe" containerName="redis"
Sep 10 10:52:46.898844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.898826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:46.901373 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.901343    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-txl8b\""
Sep 10 10:52:46.901520 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.901410    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 10 10:52:46.902359 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.902338    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 10 10:52:46.912003 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:46.911981    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:52:47.028256 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.028223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km8xx\" (UniqueName: \"kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx\") pod \"feast-operator-controller-manager-689b877b4b-74v5h\" (UID: \"210ca52e-eb2c-447a-9324-3256ad615f0c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:47.128928 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.128898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km8xx\" (UniqueName: \"kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx\") pod \"feast-operator-controller-manager-689b877b4b-74v5h\" (UID: \"210ca52e-eb2c-447a-9324-3256ad615f0c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:47.140355 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.140326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km8xx\" (UniqueName: \"kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx\") pod \"feast-operator-controller-manager-689b877b4b-74v5h\" (UID: \"210ca52e-eb2c-447a-9324-3256ad615f0c\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:47.209328 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.209291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:47.481959 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.481882    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:52:47.485084 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:52:47.485055    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210ca52e_eb2c_447a_9324_3256ad615f0c.slice/crio-7c79ad3b1320bbec10ccd7bb8684b6371c7c259d81a44536cac10590c550f9c7 WatchSource:0}: Error finding container 7c79ad3b1320bbec10ccd7bb8684b6371c7c259d81a44536cac10590c550f9c7: Status 404 returned error can't find the container with id 7c79ad3b1320bbec10ccd7bb8684b6371c7c259d81a44536cac10590c550f9c7
Sep 10 10:52:47.486966 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.486949    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 10:52:47.907795 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:47.907704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" event={"ID":"210ca52e-eb2c-447a-9324-3256ad615f0c","Type":"ContainerStarted","Data":"7c79ad3b1320bbec10ccd7bb8684b6371c7c259d81a44536cac10590c550f9c7"}
Sep 10 10:52:49.918521 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:49.918445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" event={"ID":"210ca52e-eb2c-447a-9324-3256ad615f0c","Type":"ContainerStarted","Data":"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"}
Sep 10 10:52:49.918521 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:49.918496    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:52:49.934367 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:52:49.934324    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" podStartSLOduration=1.94526438 podStartE2EDuration="3.934310585s" totalImagesPullingTime="1.989046205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:52:49.934039113 +0000 UTC m=+1088.501519749" watchObservedRunningTime="2026-09-10 10:52:49.934310585 +0000 UTC m=+1088.501791201"
Sep 10 10:53:00.922268 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:00.922235    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:53:04.893522 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.893486    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:53:04.902107 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.902083    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:04.904331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904299    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 10 10:53:04.904489 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904365    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 10 10:53:04.904489 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 10 10:53:04.904691 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904674    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 10 10:53:04.904770 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904683    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 10 10:53:04.904770 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.904708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lzr6h\""
Sep 10 10:53:04.905282 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.905265    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 10 10:53:04.908028 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:04.908006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:53:05.065424 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.065424 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcxwd\" (UniqueName: \"kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.065633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.065633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065545    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.065633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.065633 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.065591    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166066 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.165997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166066 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166066 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166124    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcxwd\" (UniqueName: \"kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:53:05.166182    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:53:05.166258    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 10:53:05.166317 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:53:05.166263    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls podName:88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99 nodeName:}" failed. No retries permitted until 2026-09-10 10:53:05.666240222 +0000 UTC m=+1104.233720834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-mq72k" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 10 10:53:05.166598 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:53:05.166326    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls podName:88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99 nodeName:}" failed. No retries permitted until 2026-09-10 10:53:05.666308617 +0000 UTC m=+1104.233789230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-mq72k" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 10:53:05.166598 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.166471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.168501 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.168483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.168501 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.168493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.175783 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.175759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcxwd\" (UniqueName: \"kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.671928 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.671889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.672118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.671949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.674263 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.674239    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.674407 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.674370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mq72k\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:05.811975 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:05.811936    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:06.088646 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:06.088619    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:53:06.090202 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:53:06.090179    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88e6aba2_b243_47d0_b5ac_9e9d7c7f6b99.slice/crio-29cccc50329bdd2c95b3da3be1d03fce5aa29fe46e243b44ab2f2f0e8e1086cc WatchSource:0}: Error finding container 29cccc50329bdd2c95b3da3be1d03fce5aa29fe46e243b44ab2f2f0e8e1086cc: Status 404 returned error can't find the container with id 29cccc50329bdd2c95b3da3be1d03fce5aa29fe46e243b44ab2f2f0e8e1086cc
Sep 10 10:53:06.980167 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:06.980129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"29cccc50329bdd2c95b3da3be1d03fce5aa29fe46e243b44ab2f2f0e8e1086cc"}
Sep 10 10:53:19.033154 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:19.033106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"}
Sep 10 10:53:24.053626 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:24.053592    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096" exitCode=0
Sep 10 10:53:24.053980 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:24.053667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"}
Sep 10 10:53:25.062838 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:25.062799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"}
Sep 10 10:53:31.090112 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:31.090073    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7" exitCode=0
Sep 10 10:53:31.090535 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:31.090146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"}
Sep 10 10:53:32.106006 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.105924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"}
Sep 10 10:53:32.106488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.106050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"}
Sep 10 10:53:32.106488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.106077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"}
Sep 10 10:53:32.106488 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.106129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerStarted","Data":"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"}
Sep 10 10:53:32.135666 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.135597    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podStartSLOduration=15.438249337 podStartE2EDuration="28.135579011s" totalImagesPullingTime="12.697329674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:53:32.132578161 +0000 UTC m=+1130.700058804" watchObservedRunningTime="2026-09-10 10:53:32.135579011 +0000 UTC m=+1130.703059629"
Sep 10 10:53:32.813014 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.812974    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:32.813214 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.813045    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:32.813214 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.813068    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:32.813214 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.813085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:32.815142 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.815093    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:53:32.815273 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.815147    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Sep 10 10:53:32.815273 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.815197    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Sep 10 10:53:32.815273 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:32.815147    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:53:35.812672 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.812640    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:35.813336 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.813310    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:35.813487 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.812771    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Sep 10 10:53:35.813594 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.812898    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:53:35.813746 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.812927    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Sep 10 10:53:35.813746 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.813342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:35.813909 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.813787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:35.813909 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:35.812842    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:53:38.812827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:38.812780    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Sep 10 10:53:38.813925 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:38.812802    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:53:38.813925 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:38.812938    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:53:38.813925 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:38.813659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:38.814539 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:38.814514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:41.812608 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:41.812578    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:41.813019 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:41.812773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:41.813560 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:41.813532    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:41.813672 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:41.813608    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:41.817792 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:41.817772    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:53:42.156519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:53:42.156441    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:54:41.861878 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:41.861850    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:54:41.863916 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:41.863894    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:54:45.288033 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.288001    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:54:45.288534 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.288233    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry" containerID="cri-o://cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44" gracePeriod=30
Sep 10 10:54:45.288534 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.288299    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline" containerID="cri-o://18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068" gracePeriod=30
Sep 10 10:54:45.288534 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.288292    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" containerID="cri-o://3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00" gracePeriod=30
Sep 10 10:54:45.288534 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.288415    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" containerID="cri-o://0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091" gracePeriod=30
Sep 10 10:54:45.795310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.795277    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:54:45.799017 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.798992    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.801635 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.801611    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bv8dp\""
Sep 10 10:54:45.811281 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.811255    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:54:45.830714 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.830844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.830844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2wn\" (UniqueName: \"kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.830932 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.830932 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.831004 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.830931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.931807 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2wn\" (UniqueName: \"kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.931971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.931971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.931971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.931971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.932194 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.931986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.932194 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:54:45.932130    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 10:54:45.932304 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:54:45.932220    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls podName:15d67ddc-f0f2-4540-929b-dd11f628b123 nodeName:}" failed. No retries permitted until 2026-09-10 10:54:46.432198893 +0000 UTC m=+1204.999679501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-gkjfc" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 10:54:45.932467 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.932441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.934314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.934291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.934431 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.934333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.934682 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.934661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:45.940775 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:45.940742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2wn\" (UniqueName: \"kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:46.391757 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.391667    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00" exitCode=0
Sep 10 10:54:46.391757 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.391695    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091" exitCode=0
Sep 10 10:54:46.391757 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.391737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"}
Sep 10 10:54:46.392149 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.391779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"}
Sep 10 10:54:46.436626 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.436593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:46.438860 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.438837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gkjfc\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:46.708863 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.708838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:54:46.990477 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:46.990451    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:54:46.992097 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:54:46.992071    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15d67ddc_f0f2_4540_929b_dd11f628b123.slice/crio-eb6d6c2c63105de1077e9112ec7d3b0aa0a89bc629731541b6027ed76179fe2e WatchSource:0}: Error finding container eb6d6c2c63105de1077e9112ec7d3b0aa0a89bc629731541b6027ed76179fe2e: Status 404 returned error can't find the container with id eb6d6c2c63105de1077e9112ec7d3b0aa0a89bc629731541b6027ed76179fe2e
Sep 10 10:54:47.398908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:47.398822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"9b3036b2a55b1b87448220ea00ab9f909e2762ab1e00567af0ff2baa45bf854f"}
Sep 10 10:54:47.398908 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:47.398875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"eb6d6c2c63105de1077e9112ec7d3b0aa0a89bc629731541b6027ed76179fe2e"}
Sep 10 10:54:51.813664 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:51.813615    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:54:52.153981 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:52.153887    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:54:52.419643 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:52.419564    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="9b3036b2a55b1b87448220ea00ab9f909e2762ab1e00567af0ff2baa45bf854f" exitCode=0
Sep 10 10:54:52.419643 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:52.419600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"9b3036b2a55b1b87448220ea00ab9f909e2762ab1e00567af0ff2baa45bf854f"}
Sep 10 10:54:53.424954 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:53.424917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"f21133534d38cd0e72e62647c4657373b22cce83ae2196ecd8114e0431f8feb9"}
Sep 10 10:54:58.447300 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:58.447218    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="f21133534d38cd0e72e62647c4657373b22cce83ae2196ecd8114e0431f8feb9" exitCode=0
Sep 10 10:54:58.447300 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:58.447287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"f21133534d38cd0e72e62647c4657373b22cce83ae2196ecd8114e0431f8feb9"}
Sep 10 10:54:59.466331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:59.466286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"595c3abd33f11be525241850f1faa876465acae6dad441a14305b4d9e9b3e664"}
Sep 10 10:54:59.466818 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:59.466353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"e13a7172456c67606b4f3e69be8473c7c9943d5b8c8c5aa52c0f01c460ce917f"}
Sep 10 10:54:59.466818 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:59.466402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"717d5aa2798738b98fd066df4971675490ba9c0ad2b3d7b2b0b03fb332066540"}
Sep 10 10:54:59.466818 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:59.466424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerStarted","Data":"f29e2e6e62d72e742732f83a628ec80b313d3b8fb212b20430dfd1799f216ae5"}
Sep 10 10:54:59.497660 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:54:59.497239    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podStartSLOduration=14.497218492 podStartE2EDuration="14.497218492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:54:59.496034543 +0000 UTC m=+1218.063515160" watchObservedRunningTime="2026-09-10 10:54:59.497218492 +0000 UTC m=+1218.064699108"
Sep 10 10:55:01.710001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.709951    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:01.710479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.710026    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:01.710479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.710047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:01.710479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.710065    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:01.712101 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.712059    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
Sep 10 10:55:01.712101 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.712084    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Sep 10 10:55:01.712289 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.712092    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Sep 10 10:55:01.712289 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.712146    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Sep 10 10:55:01.813682 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:01.813634    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:55:02.154166 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:02.154053    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:55:04.710082 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:04.710023    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
Sep 10 10:55:04.710561 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:04.710024    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Sep 10 10:55:04.710650 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:04.710613    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Sep 10 10:55:04.710717 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:04.710667    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Sep 10 10:55:06.709241 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:06.709205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:06.709617 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:06.709259    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:06.709617 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:06.709276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:06.709617 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:06.709289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.710568 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.710372    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.711003 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.710638    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.711003 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.710895    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.711424 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.711402    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.711538 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.711458    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.711538 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.711496    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:07.715745 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:07.715724    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:08.515481 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:08.515446    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:55:11.813547 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:11.813500    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Sep 10 10:55:11.813919 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:11.813639    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:55:12.153512 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:12.153428    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Sep 10 10:55:12.153681 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:12.153548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:55:15.484225 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.484200    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:55:15.540331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540300    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068" exitCode=137
Sep 10 10:55:15.540331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540324    2583 generic.go:356] "Generic (PLEG): container finished" podID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerID="cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44" exitCode=137
Sep 10 10:55:15.540331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"}
Sep 10 10:55:15.540605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540395    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"}
Sep 10 10:55:15.540605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k" event={"ID":"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99","Type":"ContainerDied","Data":"29cccc50329bdd2c95b3da3be1d03fce5aa29fe46e243b44ab2f2f0e8e1086cc"}
Sep 10 10:55:15.540605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540416    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"
Sep 10 10:55:15.540605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.540435    2583 scope.go:117] "RemoveContainer" containerID="3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"
Sep 10 10:55:15.548336 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.548318    2583 scope.go:117] "RemoveContainer" containerID="18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"
Sep 10 10:55:15.555224 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.555207    2583 scope.go:117] "RemoveContainer" containerID="0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"
Sep 10 10:55:15.561901 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.561883    2583 scope.go:117] "RemoveContainer" containerID="cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"
Sep 10 10:55:15.568728 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.568712    2583 scope.go:117] "RemoveContainer" containerID="ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"
Sep 10 10:55:15.577294 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.577278    2583 scope.go:117] "RemoveContainer" containerID="898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"
Sep 10 10:55:15.584011 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.583981    2583 scope.go:117] "RemoveContainer" containerID="3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"
Sep 10 10:55:15.584284 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.584266    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00\": container with ID starting with 3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00 not found: ID does not exist" containerID="3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"
Sep 10 10:55:15.584332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584293    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"} err="failed to get container status \"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00\": rpc error: code = NotFound desc = could not find container \"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00\": container with ID starting with 3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00 not found: ID does not exist"
Sep 10 10:55:15.584332 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584313    2583 scope.go:117] "RemoveContainer" containerID="18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"
Sep 10 10:55:15.584574 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.584554    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068\": container with ID starting with 18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068 not found: ID does not exist" containerID="18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"
Sep 10 10:55:15.584638 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584583    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"} err="failed to get container status \"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068\": rpc error: code = NotFound desc = could not find container \"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068\": container with ID starting with 18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068 not found: ID does not exist"
Sep 10 10:55:15.584638 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584606    2583 scope.go:117] "RemoveContainer" containerID="0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"
Sep 10 10:55:15.584829 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.584814    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091\": container with ID starting with 0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091 not found: ID does not exist" containerID="0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"
Sep 10 10:55:15.584866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584833    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"} err="failed to get container status \"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091\": rpc error: code = NotFound desc = could not find container \"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091\": container with ID starting with 0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091 not found: ID does not exist"
Sep 10 10:55:15.584866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.584853    2583 scope.go:117] "RemoveContainer" containerID="cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"
Sep 10 10:55:15.585068 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.585050    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44\": container with ID starting with cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44 not found: ID does not exist" containerID="cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"
Sep 10 10:55:15.585130 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585074    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"} err="failed to get container status \"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44\": rpc error: code = NotFound desc = could not find container \"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44\": container with ID starting with cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44 not found: ID does not exist"
Sep 10 10:55:15.585130 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585093    2583 scope.go:117] "RemoveContainer" containerID="ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"
Sep 10 10:55:15.585300 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.585286    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7\": container with ID starting with ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7 not found: ID does not exist" containerID="ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"
Sep 10 10:55:15.585338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585303    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"} err="failed to get container status \"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7\": rpc error: code = NotFound desc = could not find container \"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7\": container with ID starting with ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7 not found: ID does not exist"
Sep 10 10:55:15.585338 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585314    2583 scope.go:117] "RemoveContainer" containerID="898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"
Sep 10 10:55:15.585622 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:55:15.585572    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096\": container with ID starting with 898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096 not found: ID does not exist" containerID="898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"
Sep 10 10:55:15.585622 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585587    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"} err="failed to get container status \"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096\": rpc error: code = NotFound desc = could not find container \"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096\": container with ID starting with 898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096 not found: ID does not exist"
Sep 10 10:55:15.585622 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585597    2583 scope.go:117] "RemoveContainer" containerID="3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"
Sep 10 10:55:15.585814 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585796    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00"} err="failed to get container status \"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00\": rpc error: code = NotFound desc = could not find container \"3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00\": container with ID starting with 3aa233ce74e3626f2203daf6294d9bc5f61c6caa5db6dd4902b22efc52415d00 not found: ID does not exist"
Sep 10 10:55:15.585852 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.585815    2583 scope.go:117] "RemoveContainer" containerID="18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"
Sep 10 10:55:15.586059 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586042    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068"} err="failed to get container status \"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068\": rpc error: code = NotFound desc = could not find container \"18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068\": container with ID starting with 18a0bff78393d428352c0c54d485d3802db411694f556a1f729c6504795cb068 not found: ID does not exist"
Sep 10 10:55:15.586118 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586069    2583 scope.go:117] "RemoveContainer" containerID="0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"
Sep 10 10:55:15.586295 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586278    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091"} err="failed to get container status \"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091\": rpc error: code = NotFound desc = could not find container \"0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091\": container with ID starting with 0c1ee6e040a435b5ac7aa7e3b0c6534dde9afeba397a25ab71194c7323829091 not found: ID does not exist"
Sep 10 10:55:15.586335 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586296    2583 scope.go:117] "RemoveContainer" containerID="cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"
Sep 10 10:55:15.586547 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586529    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44"} err="failed to get container status \"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44\": rpc error: code = NotFound desc = could not find container \"cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44\": container with ID starting with cbb7332f82031e18841b3a2cb1fa096c9830eea0c63cbd9586fe1f0136fe4c44 not found: ID does not exist"
Sep 10 10:55:15.586600 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586548    2583 scope.go:117] "RemoveContainer" containerID="ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"
Sep 10 10:55:15.586758 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586737    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7"} err="failed to get container status \"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7\": rpc error: code = NotFound desc = could not find container \"ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7\": container with ID starting with ce63c51ac9874d2fde2cb2670a9def51d0fe8b3d61ad7cdbd2f5f5e4ac6044a7 not found: ID does not exist"
Sep 10 10:55:15.586800 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586759    2583 scope.go:117] "RemoveContainer" containerID="898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"
Sep 10 10:55:15.586951 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.586935    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096"} err="failed to get container status \"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096\": rpc error: code = NotFound desc = could not find container \"898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096\": container with ID starting with 898df819d49ff0a82cbc10be785b59fb26848fff1532d2abef8be68712417096 not found: ID does not exist"
Sep 10 10:55:15.594625 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594609    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.594687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594664    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcxwd\" (UniqueName: \"kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.594687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594682    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.594911 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594893    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.594971 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594951    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.595023 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.594984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") pod \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\" (UID: \"88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99\") "
Sep 10 10:55:15.595135 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.595110    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data" (OuterVolumeSpecName: "feast-data") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:55:15.595271 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.595250    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.596957 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.596931    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:55:15.597145 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.597123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:55:15.597274 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.597251    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd" (OuterVolumeSpecName: "kube-api-access-xcxwd") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "kube-api-access-xcxwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:55:15.597318 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.597253    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls" (OuterVolumeSpecName: "online-tls") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:55:15.597422 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.597407    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" (UID: "88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:55:15.695811 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.695776    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcxwd\" (UniqueName: \"kubernetes.io/projected/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-kube-api-access-xcxwd\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.695811 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.695805    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.695811 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.695815    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.696025 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.695825    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.696025 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.695831    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:55:15.877687 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.877658    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:55:15.890953 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.890931    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mq72k"]
Sep 10 10:55:15.918963 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:55:15.918937    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" path="/var/lib/kubelet/pods/88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99/volumes"
Sep 10 10:56:10.640482 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640450    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640723    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="feast-init"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640733    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="feast-init"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640742    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640747    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640755    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640760    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640767    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640772    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640780    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="feast-apply"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640785    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="feast-apply"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640799    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640805    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640852    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="registry"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640861    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="ui"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640869    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="online"
Sep 10 10:56:10.640946 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.640875    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e6aba2-b243-47d0-b5ac-9e9d7c7f6b99" containerName="offline"
Sep 10 10:56:10.645436 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.645420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.647991 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.647964    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 10 10:56:10.647991 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.647976    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 10 10:56:10.648179 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.647977    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 10 10:56:10.648179 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.648081    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 10 10:56:10.648179 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.648167    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 10 10:56:10.648327 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.648313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-474ln\""
Sep 10 10:56:10.648457 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.648442    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 10 10:56:10.655547 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.655526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:56:10.701992 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.701969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.702109 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.701998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7zr\" (UniqueName: \"kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.702109 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.702045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.702109 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.702092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.702215 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.702135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.702215 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.702155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803548 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803548 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7zr\" (UniqueName: \"kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:56:10.803681    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:56:10.803764    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls podName:152eac02-4f3a-40f6-af61-0d69c3d0b77a nodeName:}" failed. No retries permitted until 2026-09-10 10:56:11.303741682 +0000 UTC m=+1289.871222296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 10 10:56:10.803786 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:56:10.803765    2583 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 10 10:56:10.804095 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:56:10.803830    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls podName:152eac02-4f3a-40f6-af61-0d69c3d0b77a nodeName:}" failed. No retries permitted until 2026-09-10 10:56:11.303811199 +0000 UTC m=+1289.871291795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 10 10:56:10.804095 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.803925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.804322 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.804302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.806035 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.806019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:10.814368 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:10.814346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7zr\" (UniqueName: \"kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.308453 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.308416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.308618 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.308462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.310943 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.310912    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.310943 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.310938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-8gbzs\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.554614 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.554570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:11.829010 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:11.828971    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:56:11.830295 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:56:11.830270    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod152eac02_4f3a_40f6_af61_0d69c3d0b77a.slice/crio-6844e50afedf340abb018db1c63698c53ae03b82a34134ca04e16f61b2b7878b WatchSource:0}: Error finding container 6844e50afedf340abb018db1c63698c53ae03b82a34134ca04e16f61b2b7878b: Status 404 returned error can't find the container with id 6844e50afedf340abb018db1c63698c53ae03b82a34134ca04e16f61b2b7878b
Sep 10 10:56:12.762144 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:12.762109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"}
Sep 10 10:56:12.762310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:12.762159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"6844e50afedf340abb018db1c63698c53ae03b82a34134ca04e16f61b2b7878b"}
Sep 10 10:56:16.780034 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:16.780001    2583 generic.go:356] "Generic (PLEG): container finished" podID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerID="392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f" exitCode=0
Sep 10 10:56:16.780413 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:16.780052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"}
Sep 10 10:56:17.786101 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:17.786066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"}
Sep 10 10:56:38.867730 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:38.867702    2583 generic.go:356] "Generic (PLEG): container finished" podID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerID="1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850" exitCode=0
Sep 10 10:56:38.868060 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:38.867773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"}
Sep 10 10:56:39.877189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:39.877154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"}
Sep 10 10:56:39.877667 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:39.877204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"}
Sep 10 10:56:39.877667 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:39.877222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerStarted","Data":"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"}
Sep 10 10:56:39.901891 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:39.901831    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podStartSLOduration=29.901809088 podStartE2EDuration="29.901809088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:56:39.899816589 +0000 UTC m=+1318.467297220" watchObservedRunningTime="2026-09-10 10:56:39.901809088 +0000 UTC m=+1318.469289704"
Sep 10 10:56:41.554992 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.554945    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.555479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.555021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.555479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.555039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.555479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.555062    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.555479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.555078    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.555479 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.555093    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:41.556394 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.556344    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Sep 10 10:56:41.556522 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.556407    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 10 10:56:41.556522 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:41.556405    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Sep 10 10:56:44.555420 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:44.555363    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Sep 10 10:56:44.555420 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:44.555395    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 10 10:56:44.555982 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:44.555355    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Sep 10 10:56:47.555922 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:47.555893    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:47.556402 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:47.556358    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:47.556661 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:47.556644    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:47.918947 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:47.918871    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:48.555812 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:48.555765    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 10 10:56:51.258033 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:51.258002    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:51.962375 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:51.962342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:56:52.559549 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:56:52.559497    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 10 10:57:12.559563 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:12.559473    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 10:57:32.560556 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:32.560507    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 10:57:52.559541 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:52.559490    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 10:57:53.091185 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.091150    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:57:53.091400 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.091358    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" containerID="cri-o://f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27" gracePeriod=30
Sep 10 10:57:53.091499 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.091456    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" containerID="cri-o://4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65" gracePeriod=30
Sep 10 10:57:53.091597 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.091472    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline" containerID="cri-o://541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6" gracePeriod=30
Sep 10 10:57:53.232961 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.232924    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:57:53.233251 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.233213    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry" containerID="cri-o://f29e2e6e62d72e742732f83a628ec80b313d3b8fb212b20430dfd1799f216ae5" gracePeriod=30
Sep 10 10:57:53.233561 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.233271    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" containerID="cri-o://717d5aa2798738b98fd066df4971675490ba9c0ad2b3d7b2b0b03fb332066540" gracePeriod=30
Sep 10 10:57:53.233682 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.233276    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" containerID="cri-o://595c3abd33f11be525241850f1faa876465acae6dad441a14305b4d9e9b3e664" gracePeriod=30
Sep 10 10:57:53.233748 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:53.233292    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline" containerID="cri-o://e13a7172456c67606b4f3e69be8473c7c9943d5b8c8c5aa52c0f01c460ce917f" gracePeriod=30
Sep 10 10:57:54.173982 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.173946    2583 generic.go:356] "Generic (PLEG): container finished" podID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerID="4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65" exitCode=0
Sep 10 10:57:54.173982 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.173976    2583 generic.go:356] "Generic (PLEG): container finished" podID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerID="f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27" exitCode=0
Sep 10 10:57:54.174458 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.174017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"}
Sep 10 10:57:54.174458 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.174062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"}
Sep 10 10:57:54.177170 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.177151    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="595c3abd33f11be525241850f1faa876465acae6dad441a14305b4d9e9b3e664" exitCode=0
Sep 10 10:57:54.177170 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.177169    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="717d5aa2798738b98fd066df4971675490ba9c0ad2b3d7b2b0b03fb332066540" exitCode=0
Sep 10 10:57:54.177310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.177198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"595c3abd33f11be525241850f1faa876465acae6dad441a14305b4d9e9b3e664"}
Sep 10 10:57:54.177310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:54.177223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"717d5aa2798738b98fd066df4971675490ba9c0ad2b3d7b2b0b03fb332066540"}
Sep 10 10:57:57.711507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:57.711455    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Sep 10 10:57:57.916900 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:57.916852    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Sep 10 10:57:58.512953 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:57:58.512916    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Sep 10 10:58:01.259058 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:01.259023    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 10 10:58:07.711108 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:07.711059    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Sep 10 10:58:07.916702 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:07.916661    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Sep 10 10:58:08.512807 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:08.512762    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Sep 10 10:58:11.258910 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:11.258861    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 10 10:58:17.711496 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:17.711444    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Sep 10 10:58:17.712055 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:17.711595    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:58:17.916846 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:17.916798    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Sep 10 10:58:17.919409 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:17.919373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:58:18.512845 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:18.512807    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Sep 10 10:58:18.513017 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:18.512937    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:58:21.258955 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:21.258913    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 10 10:58:21.259396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:21.259022    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:58:23.263401 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.263348    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:58:23.288481 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.288454    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="e13a7172456c67606b4f3e69be8473c7c9943d5b8c8c5aa52c0f01c460ce917f" exitCode=137
Sep 10 10:58:23.288481 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.288478    2583 generic.go:356] "Generic (PLEG): container finished" podID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerID="f29e2e6e62d72e742732f83a628ec80b313d3b8fb212b20430dfd1799f216ae5" exitCode=137
Sep 10 10:58:23.288638 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.288524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"e13a7172456c67606b4f3e69be8473c7c9943d5b8c8c5aa52c0f01c460ce917f"}
Sep 10 10:58:23.288638 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.288568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"f29e2e6e62d72e742732f83a628ec80b313d3b8fb212b20430dfd1799f216ae5"}
Sep 10 10:58:23.291108 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.291086    2583 generic.go:356] "Generic (PLEG): container finished" podID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerID="541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6" exitCode=137
Sep 10 10:58:23.291192 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.291145    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"
Sep 10 10:58:23.291192 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.291149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"}
Sep 10 10:58:23.291261 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.291197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs" event={"ID":"152eac02-4f3a-40f6-af61-0d69c3d0b77a","Type":"ContainerDied","Data":"6844e50afedf340abb018db1c63698c53ae03b82a34134ca04e16f61b2b7878b"}
Sep 10 10:58:23.291261 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.291217    2583 scope.go:117] "RemoveContainer" containerID="4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"
Sep 10 10:58:23.307240 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.307216    2583 scope.go:117] "RemoveContainer" containerID="541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"
Sep 10 10:58:23.314965 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.314931    2583 scope.go:117] "RemoveContainer" containerID="f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"
Sep 10 10:58:23.321979 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.321960    2583 scope.go:117] "RemoveContainer" containerID="1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"
Sep 10 10:58:23.328802 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.328778    2583 scope.go:117] "RemoveContainer" containerID="392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"
Sep 10 10:58:23.335315 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.335299    2583 scope.go:117] "RemoveContainer" containerID="4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"
Sep 10 10:58:23.335595 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:23.335575    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65\": container with ID starting with 4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65 not found: ID does not exist" containerID="4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"
Sep 10 10:58:23.335657 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.335603    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65"} err="failed to get container status \"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65\": rpc error: code = NotFound desc = could not find container \"4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65\": container with ID starting with 4c1e2a90cb254df4ea8459f5b904381cd292a5aff1fe8d8eea7d8f8641eb0a65 not found: ID does not exist"
Sep 10 10:58:23.335657 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.335622    2583 scope.go:117] "RemoveContainer" containerID="541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"
Sep 10 10:58:23.335893 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:23.335869    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6\": container with ID starting with 541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6 not found: ID does not exist" containerID="541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"
Sep 10 10:58:23.335932 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.335894    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6"} err="failed to get container status \"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6\": rpc error: code = NotFound desc = could not find container \"541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6\": container with ID starting with 541e96e6f80cd34bf96c5aa73767409490523f0d217ffbce442913266c47a8b6 not found: ID does not exist"
Sep 10 10:58:23.335932 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.335910    2583 scope.go:117] "RemoveContainer" containerID="f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"
Sep 10 10:58:23.336142 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:23.336126    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27\": container with ID starting with f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27 not found: ID does not exist" containerID="f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"
Sep 10 10:58:23.336176 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.336147    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27"} err="failed to get container status \"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27\": rpc error: code = NotFound desc = could not find container \"f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27\": container with ID starting with f76e51194f95a8d21453ad862c1d74e57d20b5153f4690908e3154233c260d27 not found: ID does not exist"
Sep 10 10:58:23.336176 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.336160    2583 scope.go:117] "RemoveContainer" containerID="1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"
Sep 10 10:58:23.336415 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:23.336374    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850\": container with ID starting with 1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850 not found: ID does not exist" containerID="1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"
Sep 10 10:58:23.336501 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.336422    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850"} err="failed to get container status \"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850\": rpc error: code = NotFound desc = could not find container \"1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850\": container with ID starting with 1989902ad1fee06962d4cc559fc35a1c1cf26a37f8e14f53ff929b2d36b79850 not found: ID does not exist"
Sep 10 10:58:23.336501 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.336440    2583 scope.go:117] "RemoveContainer" containerID="392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"
Sep 10 10:58:23.336711 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:23.336694    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f\": container with ID starting with 392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f not found: ID does not exist" containerID="392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"
Sep 10 10:58:23.336759 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.336715    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f"} err="failed to get container status \"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f\": rpc error: code = NotFound desc = could not find container \"392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f\": container with ID starting with 392b6c2d45afee529d768b0e70f277d5089a59d141d687afdac60b1bb29cb67f not found: ID does not exist"
Sep 10 10:58:23.353015 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.352970    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353015 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353113 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353113 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353070    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf7zr\" (UniqueName: \"kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353132    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353189 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353157    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls\") pod \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\" (UID: \"152eac02-4f3a-40f6-af61-0d69c3d0b77a\") "
Sep 10 10:58:23.353612 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 10:58:23.353704 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.353650    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data" (OuterVolumeSpecName: "feast-data") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:58:23.355132 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.355096    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr" (OuterVolumeSpecName: "kube-api-access-xf7zr") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "kube-api-access-xf7zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:58:23.355132 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.355129    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.355412 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.355361    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.355495 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.355407    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls" (OuterVolumeSpecName: "online-tls") pod "152eac02-4f3a-40f6-af61-0d69c3d0b77a" (UID: "152eac02-4f3a-40f6-af61-0d69c3d0b77a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.453866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453829    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf7zr\" (UniqueName: \"kubernetes.io/projected/152eac02-4f3a-40f6-af61-0d69c3d0b77a-kube-api-access-xf7zr\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.453866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453863    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.453866 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453873    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/152eac02-4f3a-40f6-af61-0d69c3d0b77a-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.454024 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453882    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/152eac02-4f3a-40f6-af61-0d69c3d0b77a-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.454024 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453890    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.454024 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.453917    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/152eac02-4f3a-40f6-af61-0d69c3d0b77a-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:23.616602 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.616539    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:58:23.621813 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.621787    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-8gbzs"]
Sep 10 10:58:23.869806 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.869750    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:58:23.919228 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.919196    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" path="/var/lib/kubelet/pods/152eac02-4f3a-40f6-af61-0d69c3d0b77a/volumes"
Sep 10 10:58:23.958369 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958341    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958369 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958583 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958421    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958583 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958583 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r2wn\" (UniqueName: \"kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958583 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958495    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") pod \"15d67ddc-f0f2-4540-929b-dd11f628b123\" (UID: \"15d67ddc-f0f2-4540-929b-dd11f628b123\") "
Sep 10 10:58:23.958983 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.958954    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data" (OuterVolumeSpecName: "feast-data") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 10:58:23.960584 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.960560    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.960672 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.960614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls" (OuterVolumeSpecName: "online-tls") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.960672 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.960634    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn" (OuterVolumeSpecName: "kube-api-access-9r2wn") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "kube-api-access-9r2wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:58:23.960846 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.960829    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:23.960884 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:23.960865    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "15d67ddc-f0f2-4540-929b-dd11f628b123" (UID: "15d67ddc-f0f2-4540-929b-dd11f628b123"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 10:58:24.059391 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059351    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.059507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059394    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r2wn\" (UniqueName: \"kubernetes.io/projected/15d67ddc-f0f2-4540-929b-dd11f628b123-kube-api-access-9r2wn\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.059507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059407    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.059507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059416    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.059507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059424    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/15d67ddc-f0f2-4540-929b-dd11f628b123-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.059507 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.059431    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/15d67ddc-f0f2-4540-929b-dd11f628b123-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:24.297310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.297280    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"
Sep 10 10:58:24.297310 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.297291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc" event={"ID":"15d67ddc-f0f2-4540-929b-dd11f628b123","Type":"ContainerDied","Data":"eb6d6c2c63105de1077e9112ec7d3b0aa0a89bc629731541b6027ed76179fe2e"}
Sep 10 10:58:24.297838 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.297341    2583 scope.go:117] "RemoveContainer" containerID="595c3abd33f11be525241850f1faa876465acae6dad441a14305b4d9e9b3e664"
Sep 10 10:58:24.306486 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.306463    2583 scope.go:117] "RemoveContainer" containerID="e13a7172456c67606b4f3e69be8473c7c9943d5b8c8c5aa52c0f01c460ce917f"
Sep 10 10:58:24.313702 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.313683    2583 scope.go:117] "RemoveContainer" containerID="717d5aa2798738b98fd066df4971675490ba9c0ad2b3d7b2b0b03fb332066540"
Sep 10 10:58:24.320692 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.320677    2583 scope.go:117] "RemoveContainer" containerID="f29e2e6e62d72e742732f83a628ec80b313d3b8fb212b20430dfd1799f216ae5"
Sep 10 10:58:24.321813 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.321794    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:58:24.328017 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.328002    2583 scope.go:117] "RemoveContainer" containerID="f21133534d38cd0e72e62647c4657373b22cce83ae2196ecd8114e0431f8feb9"
Sep 10 10:58:24.328091 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.328072    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gkjfc"]
Sep 10 10:58:24.334570 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:24.334545    2583 scope.go:117] "RemoveContainer" containerID="9b3036b2a55b1b87448220ea00ab9f909e2762ab1e00567af0ff2baa45bf854f"
Sep 10 10:58:25.919396 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:25.919346    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" path="/var/lib/kubelet/pods/15d67ddc-f0f2-4540-929b-dd11f628b123/volumes"
Sep 10 10:58:42.061834 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.061793    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:58:42.062294 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.062040    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" podUID="210ca52e-eb2c-447a-9324-3256ad615f0c" containerName="manager" containerID="cri-o://f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2" gracePeriod=10
Sep 10 10:58:42.307967 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.307942    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:58:42.369809 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.369776    2583 generic.go:356] "Generic (PLEG): container finished" podID="210ca52e-eb2c-447a-9324-3256ad615f0c" containerID="f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2" exitCode=0
Sep 10 10:58:42.369958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.369822    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"
Sep 10 10:58:42.369958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.369855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" event={"ID":"210ca52e-eb2c-447a-9324-3256ad615f0c","Type":"ContainerDied","Data":"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"}
Sep 10 10:58:42.369958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.369908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h" event={"ID":"210ca52e-eb2c-447a-9324-3256ad615f0c","Type":"ContainerDied","Data":"7c79ad3b1320bbec10ccd7bb8684b6371c7c259d81a44536cac10590c550f9c7"}
Sep 10 10:58:42.369958 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.369939    2583 scope.go:117] "RemoveContainer" containerID="f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"
Sep 10 10:58:42.378282 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.378264    2583 scope.go:117] "RemoveContainer" containerID="f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"
Sep 10 10:58:42.378607 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:58:42.378590    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2\": container with ID starting with f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2 not found: ID does not exist" containerID="f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"
Sep 10 10:58:42.378659 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.378617    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2"} err="failed to get container status \"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2\": rpc error: code = NotFound desc = could not find container \"f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2\": container with ID starting with f49ad9b9399d57898e297cdb22a15ee39ea50b2125cc70be3d5d2686ccf75ef2 not found: ID does not exist"
Sep 10 10:58:42.395463 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.395439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km8xx\" (UniqueName: \"kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx\") pod \"210ca52e-eb2c-447a-9324-3256ad615f0c\" (UID: \"210ca52e-eb2c-447a-9324-3256ad615f0c\") "
Sep 10 10:58:42.397401 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.397365    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx" (OuterVolumeSpecName: "kube-api-access-km8xx") pod "210ca52e-eb2c-447a-9324-3256ad615f0c" (UID: "210ca52e-eb2c-447a-9324-3256ad615f0c"). InnerVolumeSpecName "kube-api-access-km8xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 10:58:42.496561 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.496495    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km8xx\" (UniqueName: \"kubernetes.io/projected/210ca52e-eb2c-447a-9324-3256ad615f0c-kube-api-access-km8xx\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 10:58:42.691886 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.691859    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:58:42.693773 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:42.693751    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-74v5h"]
Sep 10 10:58:43.919193 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:43.919160    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210ca52e-eb2c-447a-9324-3256ad615f0c" path="/var/lib/kubelet/pods/210ca52e-eb2c-447a-9324-3256ad615f0c/volumes"
Sep 10 10:58:46.487932 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.487896    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"]
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488152    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488162    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488172    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="feast-init"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488177    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="feast-init"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488183    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="feast-apply"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488189    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="feast-apply"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488198    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488204    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488211    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="feast-init"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488217    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="feast-init"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488222    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488227    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488237    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488241    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488246    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488251    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488258    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210ca52e-eb2c-447a-9324-3256ad615f0c" containerName="manager"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="210ca52e-eb2c-447a-9324-3256ad615f0c" containerName="manager"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488273    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488278    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488285    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="feast-apply"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488290    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="feast-apply"
Sep 10 10:58:46.488286 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488296    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488301    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488337    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="offline"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488343    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="ui"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488350    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="ui"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488355    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="online"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488359    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="152eac02-4f3a-40f6-af61-0d69c3d0b77a" containerName="offline"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488365    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="registry"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488371    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="210ca52e-eb2c-447a-9324-3256ad615f0c" containerName="manager"
Sep 10 10:58:46.489001 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.488375    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d67ddc-f0f2-4540-929b-dd11f628b123" containerName="online"
Sep 10 10:58:46.492269 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.492253    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:46.495085 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.495066    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-txl8b\""
Sep 10 10:58:46.495311 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.495296    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 10 10:58:46.496331 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.496317    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 10 10:58:46.499723 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.499701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"]
Sep 10 10:58:46.626172 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.626120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9zpw\" (UniqueName: \"kubernetes.io/projected/f976cfa4-098b-4cb5-aa08-706037aa1ae1-kube-api-access-f9zpw\") pod \"feast-operator-controller-manager-689b877b4b-g2gwd\" (UID: \"f976cfa4-098b-4cb5-aa08-706037aa1ae1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:46.726862 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.726816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9zpw\" (UniqueName: \"kubernetes.io/projected/f976cfa4-098b-4cb5-aa08-706037aa1ae1-kube-api-access-f9zpw\") pod \"feast-operator-controller-manager-689b877b4b-g2gwd\" (UID: \"f976cfa4-098b-4cb5-aa08-706037aa1ae1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:46.735987 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.735964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9zpw\" (UniqueName: \"kubernetes.io/projected/f976cfa4-098b-4cb5-aa08-706037aa1ae1-kube-api-access-f9zpw\") pod \"feast-operator-controller-manager-689b877b4b-g2gwd\" (UID: \"f976cfa4-098b-4cb5-aa08-706037aa1ae1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:46.802639 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:46.802558    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:47.072135 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:47.072062    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"]
Sep 10 10:58:47.075410 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:58:47.075369    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf976cfa4_098b_4cb5_aa08_706037aa1ae1.slice/crio-55311b2a169508d5d26a885a4fead73f0c4fd3b1059c03f8d1654f35c951bd07 WatchSource:0}: Error finding container 55311b2a169508d5d26a885a4fead73f0c4fd3b1059c03f8d1654f35c951bd07: Status 404 returned error can't find the container with id 55311b2a169508d5d26a885a4fead73f0c4fd3b1059c03f8d1654f35c951bd07
Sep 10 10:58:47.391020 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:47.390926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd" event={"ID":"f976cfa4-098b-4cb5-aa08-706037aa1ae1","Type":"ContainerStarted","Data":"2edea5a14ff34dd213ffbf40199fa02715f2b39ce8c06484b7b69f78f591cc05"}
Sep 10 10:58:47.391020 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:47.390988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd" event={"ID":"f976cfa4-098b-4cb5-aa08-706037aa1ae1","Type":"ContainerStarted","Data":"55311b2a169508d5d26a885a4fead73f0c4fd3b1059c03f8d1654f35c951bd07"}
Sep 10 10:58:47.391299 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:47.391112    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:58:47.410574 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:47.410520    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd" podStartSLOduration=1.410505166 podStartE2EDuration="1.410505166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:58:47.408642981 +0000 UTC m=+1445.976123625" watchObservedRunningTime="2026-09-10 10:58:47.410505166 +0000 UTC m=+1445.977985783"
Sep 10 10:58:58.399426 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:58:58.399373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-g2gwd"
Sep 10 10:59:05.059215 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.059183    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 10:59:05.062776 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.062755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.065513 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065492    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 10 10:59:05.065636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065541    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 10 10:59:05.065636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065512    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 10 10:59:05.065636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 10 10:59:05.065636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r776f\""
Sep 10 10:59:05.065636 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065514    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 10 10:59:05.065951 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.065935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 10 10:59:05.074825 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.074805    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 10:59:05.155605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.155605 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.155844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155626    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxrmv\" (UniqueName: \"kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.155844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.155844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.155844 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.155810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256239 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256239 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxrmv\" (UniqueName: \"kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:59:05.256432    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.256555 ip-10-0-133-250 kubenswrapper[2583]: E0910 10:59:05.256494    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls podName:bb14754a-6e1b-47ca-80f0-500412a69621 nodeName:}" failed. No retries permitted until 2026-09-10 10:59:05.756474403 +0000 UTC m=+1464.323955002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls") pod "feast-simple-feast-setup-57576b8fcf-6csbb" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621") : secret "feast-simple-feast-setup-online-tls" not found
Sep 10 10:59:05.256839 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.256705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.258827 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.258799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.258919 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.258866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.258919 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.258898    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.266277 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.266256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxrmv\" (UniqueName: \"kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.760868 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.760823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.763172 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.763153    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6csbb\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:05.971644 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:05.971604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:06.252217 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:06.252192    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 10:59:06.253966 ip-10-0-133-250 kubenswrapper[2583]: W0910 10:59:06.253931    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb14754a_6e1b_47ca_80f0_500412a69621.slice/crio-c7e18c1c9e215b8b2c18b1443e67521c85f79453fdca5b032294e3a1bda6bb85 WatchSource:0}: Error finding container c7e18c1c9e215b8b2c18b1443e67521c85f79453fdca5b032294e3a1bda6bb85: Status 404 returned error can't find the container with id c7e18c1c9e215b8b2c18b1443e67521c85f79453fdca5b032294e3a1bda6bb85
Sep 10 10:59:06.459872 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:06.459830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"3b3c9cc63f07e5b7c7ef086ca205f91c1ddd7b695c9661b4674592f29902d931"}
Sep 10 10:59:06.460028 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:06.459881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"c7e18c1c9e215b8b2c18b1443e67521c85f79453fdca5b032294e3a1bda6bb85"}
Sep 10 10:59:11.481356 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:11.481322    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="3b3c9cc63f07e5b7c7ef086ca205f91c1ddd7b695c9661b4674592f29902d931" exitCode=0
Sep 10 10:59:11.481780 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:11.481359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"3b3c9cc63f07e5b7c7ef086ca205f91c1ddd7b695c9661b4674592f29902d931"}
Sep 10 10:59:12.492945 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:12.492909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"67ff2849a11f04f2b9e79c01316e5a794449cddd4234defa2756adc8b0c7b9c3"}
Sep 10 10:59:17.514936 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:17.514906    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="67ff2849a11f04f2b9e79c01316e5a794449cddd4234defa2756adc8b0c7b9c3" exitCode=0
Sep 10 10:59:17.515289 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:17.514961    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"67ff2849a11f04f2b9e79c01316e5a794449cddd4234defa2756adc8b0c7b9c3"}
Sep 10 10:59:18.524732 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:18.524692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"6dffa18e5ef78940be40933ce18c1bcfab1a80b787c949471a41332d9d1f4261"}
Sep 10 10:59:18.525187 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:18.524752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"cbbabf53128c47c6a0b1d1fa06acbc0bedf28cc615c92f23eb756453c3925775"}
Sep 10 10:59:18.525187 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:18.524771    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"e75386068c5c12743166be47ca373f6b94ff6596b9aca6daa1b8be3e5aa8d54c"}
Sep 10 10:59:18.525187 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:18.524789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerStarted","Data":"63b023f3f0f78282ae39474ce007fcbaf20b06ddb197d5596cd2ee7731ff80ae"}
Sep 10 10:59:18.562594 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:18.562522    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podStartSLOduration=13.562498061 podStartE2EDuration="13.562498061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:59:18.549663062 +0000 UTC m=+1477.117143702" watchObservedRunningTime="2026-09-10 10:59:18.562498061 +0000 UTC m=+1477.129978679"
Sep 10 10:59:20.973569 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.972570    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:20.973569 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.972635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:20.973569 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.972658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:20.973569 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.973184    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:20.974314 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.974275    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Sep 10 10:59:20.974419 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.974350    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Sep 10 10:59:20.974485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.974296    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Sep 10 10:59:20.974485 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:20.974294    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Sep 10 10:59:23.972558 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:23.972508    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Sep 10 10:59:23.972558 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:23.972542    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Sep 10 10:59:23.973222 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:23.972509    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Sep 10 10:59:23.973222 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:23.972509    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Sep 10 10:59:25.971727 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:25.971675    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:25.972110 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:25.971750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:25.972110 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:25.971766    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:25.972110 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:25.971777    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:26.972720 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:26.972687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:26.973184 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:26.973015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:26.973450 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:26.973431    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:26.973514 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:26.973502    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:26.977986 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:26.977967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:27.567969 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:27.567942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:27.568127 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:27.567999    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:27.570598 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:27.570579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 10:59:41.887519 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:41.887487    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 10:59:41.888792 ip-10-0-133-250 kubenswrapper[2583]: I0910 10:59:41.888770    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 11:00:29.746905 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:29.746827    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 11:00:29.747468 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:29.747134    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" containerID="cri-o://6dffa18e5ef78940be40933ce18c1bcfab1a80b787c949471a41332d9d1f4261" gracePeriod=30
Sep 10 11:00:29.747468 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:29.747199    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry" containerID="cri-o://63b023f3f0f78282ae39474ce007fcbaf20b06ddb197d5596cd2ee7731ff80ae" gracePeriod=30
Sep 10 11:00:29.747468 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:29.747347    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline" containerID="cri-o://cbbabf53128c47c6a0b1d1fa06acbc0bedf28cc615c92f23eb756453c3925775" gracePeriod=30
Sep 10 11:00:29.747468 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:29.747373    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" containerID="cri-o://e75386068c5c12743166be47ca373f6b94ff6596b9aca6daa1b8be3e5aa8d54c" gracePeriod=30
Sep 10 11:00:30.251753 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.251712    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:00:30.256289 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.256270    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.261294 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.261272    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gsg48\""
Sep 10 11:00:30.273414 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.273367    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:00:30.418396 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.418553 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.418553 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvh7\" (UniqueName: \"kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.418553 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.418660 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.418660 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.418648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519503 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519503 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519503 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519841 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519516    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519841 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519841 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.519577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvh7\" (UniqueName: \"kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.519841 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:00:30.519584    2583 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 11:00:30.519841 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:00:30.519671    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls podName:ac5bfe59-6b01-47cf-873f-7a4b3e133ea2 nodeName:}" failed. No retries permitted until 2026-09-10 11:00:31.01964785 +0000 UTC m=+1549.587128460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-hj5dn" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 10 11:00:30.520085 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.520003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.522046 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.522019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.522247 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.522213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.522464 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.522430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.527840 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.527818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvh7\" (UniqueName: \"kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:30.805757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.805680    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="6dffa18e5ef78940be40933ce18c1bcfab1a80b787c949471a41332d9d1f4261" exitCode=0
Sep 10 11:00:30.805757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.805706    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="e75386068c5c12743166be47ca373f6b94ff6596b9aca6daa1b8be3e5aa8d54c" exitCode=0
Sep 10 11:00:30.806106 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.805753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"6dffa18e5ef78940be40933ce18c1bcfab1a80b787c949471a41332d9d1f4261"}
Sep 10 11:00:30.806106 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:30.805794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"e75386068c5c12743166be47ca373f6b94ff6596b9aca6daa1b8be3e5aa8d54c"}
Sep 10 11:00:31.022503 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.022466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:31.025009 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.024977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hj5dn\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:31.165845 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.165749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:31.443819 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.443791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:00:31.444981 ip-10-0-133-250 kubenswrapper[2583]: W0910 11:00:31.444954    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac5bfe59_6b01_47cf_873f_7a4b3e133ea2.slice/crio-afcb438a4bac9632c9609fe2140f94a11a4b9030ee5e79eec33a216fc8c24dc0 WatchSource:0}: Error finding container afcb438a4bac9632c9609fe2140f94a11a4b9030ee5e79eec33a216fc8c24dc0: Status 404 returned error can't find the container with id afcb438a4bac9632c9609fe2140f94a11a4b9030ee5e79eec33a216fc8c24dc0
Sep 10 11:00:31.814335 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.814245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"3b3792d0b2d4af3ce8296e18b94fb18a900ebeab68b3c219a750d51679fb5902"}
Sep 10 11:00:31.814335 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:31.814300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"afcb438a4bac9632c9609fe2140f94a11a4b9030ee5e79eec33a216fc8c24dc0"}
Sep 10 11:00:36.838888 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:36.838853    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="3b3792d0b2d4af3ce8296e18b94fb18a900ebeab68b3c219a750d51679fb5902" exitCode=0
Sep 10 11:00:36.839288 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:36.838930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"3b3792d0b2d4af3ce8296e18b94fb18a900ebeab68b3c219a750d51679fb5902"}
Sep 10 11:00:36.974164 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:36.974126    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Sep 10 11:00:37.568555 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:37.568513    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Sep 10 11:00:37.844846 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:37.844768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"7ff1c09468cc169fdd95e839b4087469fa80f0aa67746ca5a5d31b911f74a421"}
Sep 10 11:00:42.866149 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:42.866065    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="7ff1c09468cc169fdd95e839b4087469fa80f0aa67746ca5a5d31b911f74a421" exitCode=0
Sep 10 11:00:42.866149 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:42.866135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"7ff1c09468cc169fdd95e839b4087469fa80f0aa67746ca5a5d31b911f74a421"}
Sep 10 11:00:43.876404 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:43.876337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"2ecdff0dc23a4703aa1a426f5108c417726f67de793a9e220611bf439ac92647"}
Sep 10 11:00:43.876867 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:43.876431    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"4c3ba90697b5e41b2153f54f7973ca66e8598a92ac2f88d8ea857886122fb500"}
Sep 10 11:00:43.876867 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:43.876456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"56a5d53e39977030889ad3ead1143825d60bab386a60733da8ecefa62071713a"}
Sep 10 11:00:43.876867 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:43.876478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerStarted","Data":"25e4c2a604b45dfcff66ef2abf6355e2cb939921b9657dda1c75c3810442d81d"}
Sep 10 11:00:43.903431 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:43.903343    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podStartSLOduration=13.903321331 podStartE2EDuration="13.903321331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:00:43.900428521 +0000 UTC m=+1562.467909149" watchObservedRunningTime="2026-09-10 11:00:43.903321331 +0000 UTC m=+1562.470801948"
Sep 10 11:00:46.166611 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.166557    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:46.167087 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.166630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:46.167087 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.166652    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:46.167087 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.166668    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:46.168560 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.168523    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Sep 10 11:00:46.168708 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.168532    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Sep 10 11:00:46.168708 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.168514    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 10 11:00:46.168873 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.168850    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused"
Sep 10 11:00:46.973627 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:46.973575    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Sep 10 11:00:47.568446 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:47.568402    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Sep 10 11:00:49.166512 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:49.166461    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 10 11:00:49.166976 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:49.166479    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Sep 10 11:00:49.166976 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:49.166483    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused"
Sep 10 11:00:49.167153 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:49.166474    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Sep 10 11:00:51.165929 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:51.165893    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:51.166272 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:51.165962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:51.166272 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:51.165995    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:51.166272 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:51.166007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.166669 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.166635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.167163 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.167144    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.167567 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.167551    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.171952 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.171933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.923941 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.923909    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.924116 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.924088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.924166 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.924136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:52.926505 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:52.926486    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:00:56.973393 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:56.973337    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Sep 10 11:00:56.973856 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:56.973469    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 11:00:57.568615 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:57.568562    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Sep 10 11:00:57.568797 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:57.568694    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 11:00:59.952613 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:59.952577    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="cbbabf53128c47c6a0b1d1fa06acbc0bedf28cc615c92f23eb756453c3925775" exitCode=137
Sep 10 11:00:59.952613 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:59.952602    2583 generic.go:356] "Generic (PLEG): container finished" podID="bb14754a-6e1b-47ca-80f0-500412a69621" containerID="63b023f3f0f78282ae39474ce007fcbaf20b06ddb197d5596cd2ee7731ff80ae" exitCode=137
Sep 10 11:00:59.953001 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:59.952644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"cbbabf53128c47c6a0b1d1fa06acbc0bedf28cc615c92f23eb756453c3925775"}
Sep 10 11:00:59.953001 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:00:59.952680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"63b023f3f0f78282ae39474ce007fcbaf20b06ddb197d5596cd2ee7731ff80ae"}
Sep 10 11:01:00.392075 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.392051    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 11:01:00.478185 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478154    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478195    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478254    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478274    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxrmv\" (UniqueName: \"kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls\") pod \"bb14754a-6e1b-47ca-80f0-500412a69621\" (UID: \"bb14754a-6e1b-47ca-80f0-500412a69621\") "
Sep 10 11:01:00.478807 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.478776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data" (OuterVolumeSpecName: "feast-data") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:01:00.480428 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.480402    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:01:00.480680 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.480660    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls" (OuterVolumeSpecName: "online-tls") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:01:00.480809 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.480788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv" (OuterVolumeSpecName: "kube-api-access-jxrmv") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "kube-api-access-jxrmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:01:00.480869 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.480815    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:01:00.480869 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.480834    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bb14754a-6e1b-47ca-80f0-500412a69621" (UID: "bb14754a-6e1b-47ca-80f0-500412a69621"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:01:00.579757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579684    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.579757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579709    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb14754a-6e1b-47ca-80f0-500412a69621-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.579757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579717    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.579757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579726    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxrmv\" (UniqueName: \"kubernetes.io/projected/bb14754a-6e1b-47ca-80f0-500412a69621-kube-api-access-jxrmv\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.579757 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579736    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.579992 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.579765    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb14754a-6e1b-47ca-80f0-500412a69621-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:01:00.958942 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.958906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb" event={"ID":"bb14754a-6e1b-47ca-80f0-500412a69621","Type":"ContainerDied","Data":"c7e18c1c9e215b8b2c18b1443e67521c85f79453fdca5b032294e3a1bda6bb85"}
Sep 10 11:01:00.959305 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.958959    2583 scope.go:117] "RemoveContainer" containerID="6dffa18e5ef78940be40933ce18c1bcfab1a80b787c949471a41332d9d1f4261"
Sep 10 11:01:00.959305 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.958919    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"
Sep 10 11:01:00.967342 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.967015    2583 scope.go:117] "RemoveContainer" containerID="cbbabf53128c47c6a0b1d1fa06acbc0bedf28cc615c92f23eb756453c3925775"
Sep 10 11:01:00.974488 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.974466    2583 scope.go:117] "RemoveContainer" containerID="e75386068c5c12743166be47ca373f6b94ff6596b9aca6daa1b8be3e5aa8d54c"
Sep 10 11:01:00.981633 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.981613    2583 scope.go:117] "RemoveContainer" containerID="63b023f3f0f78282ae39474ce007fcbaf20b06ddb197d5596cd2ee7731ff80ae"
Sep 10 11:01:00.982544 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.982524    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 11:01:00.985763 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.985743    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6csbb"]
Sep 10 11:01:00.989201 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.989183    2583 scope.go:117] "RemoveContainer" containerID="67ff2849a11f04f2b9e79c01316e5a794449cddd4234defa2756adc8b0c7b9c3"
Sep 10 11:01:00.995995 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:00.995969    2583 scope.go:117] "RemoveContainer" containerID="3b3c9cc63f07e5b7c7ef086ca205f91c1ddd7b695c9661b4674592f29902d931"
Sep 10 11:01:01.918931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:01.918890    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" path="/var/lib/kubelet/pods/bb14754a-6e1b-47ca-80f0-500412a69621/volumes"
Sep 10 11:01:54.898154 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898117    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898435    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898447    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898461    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898466    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898479    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="feast-init"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898484    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="feast-init"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898490    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="feast-apply"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898495    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="feast-apply"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898501    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898505    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898513    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898519    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898562    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="offline"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898570    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="online"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898576    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="registry"
Sep 10 11:01:54.898642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.898581    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb14754a-6e1b-47ca-80f0-500412a69621" containerName="ui"
Sep 10 11:01:54.901606 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.901591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.904212 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.904188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 10 11:01:54.904212 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.904204    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-zdskb\""
Sep 10 11:01:54.904396 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.904195    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 10 11:01:54.904396 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.904244    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 10 11:01:54.905021 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.904917    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 10 11:01:54.905792 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.905768    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 10 11:01:54.905976 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.905955    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 10 11:01:54.913329 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.913307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:01:54.994069 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.994069 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.994276 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.994276 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.994276 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:54.994276 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:54.994226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44hc\" (UniqueName: \"kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094632 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094632 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094890 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094890 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094890 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.094890 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.094833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z44hc\" (UniqueName: \"kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.095245 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.095206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.095546 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.095523    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.097070 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.097050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.097248 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.097232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.097292 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.097256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.103715 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.103691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44hc\" (UniqueName: \"kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2pnt4\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.214996 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.214961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:01:55.490897 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:55.490871    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:01:55.493686 ip-10-0-133-250 kubenswrapper[2583]: W0910 11:01:55.493651    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1875b63_76ae_460b_9fc5_0d1f69afd97f.slice/crio-f48231654c63bcdc66af1eddb329a53d5b1f4b9ef911075fef1090488e7810c9 WatchSource:0}: Error finding container f48231654c63bcdc66af1eddb329a53d5b1f4b9ef911075fef1090488e7810c9: Status 404 returned error can't find the container with id f48231654c63bcdc66af1eddb329a53d5b1f4b9ef911075fef1090488e7810c9
Sep 10 11:01:56.173877 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:56.173835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"}
Sep 10 11:01:56.174245 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:01:56.173889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"f48231654c63bcdc66af1eddb329a53d5b1f4b9ef911075fef1090488e7810c9"}
Sep 10 11:02:01.196570 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:01.196535    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerID="56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198" exitCode=0
Sep 10 11:02:01.196947 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:01.196607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"}
Sep 10 11:02:02.202431 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:02.202398    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"}
Sep 10 11:02:24.286803 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:24.286718    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerID="20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc" exitCode=0
Sep 10 11:02:24.286803 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:24.286788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"}
Sep 10 11:02:25.296679 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:25.296646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"}
Sep 10 11:02:25.297166 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:25.296692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"}
Sep 10 11:02:25.297166 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:25.296705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerStarted","Data":"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"}
Sep 10 11:02:25.320913 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:25.320850    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podStartSLOduration=31.320831026 podStartE2EDuration="31.320831026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:02:25.317526175 +0000 UTC m=+1663.885006806" watchObservedRunningTime="2026-09-10 11:02:25.320831026 +0000 UTC m=+1663.888311643"
Sep 10 11:02:28.215930 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.215899    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:28.216512 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.215997    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:28.216512 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.216018    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:28.217914 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.217871    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 10 11:02:28.217914 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.217897    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 10 11:02:28.217914 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:28.217884    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Sep 10 11:02:31.216129 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:31.216075    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 10 11:02:31.216635 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:31.216129    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 10 11:02:31.216635 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:31.216075    2583 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Sep 10 11:02:34.216723 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.216691    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.217133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.216851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.217358 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.217335    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.217473 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.217398    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.217661 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.217642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.217811 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.217795    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:34.993720 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:34.993683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:35.216022 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:35.215986    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:35.946303 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:35.946277    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:02:36.220583 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:36.220493    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 11:02:36.949545 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:02:36.949497    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 10 11:03:36.219537 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.219489    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 10 11:03:36.952572 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.952525    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 10 11:03:36.972727 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.972691    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:03:36.972990 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.972964    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" containerID="cri-o://de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8" gracePeriod=30
Sep 10 11:03:36.973087 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.973018    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline" containerID="cri-o://f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55" gracePeriod=30
Sep 10 11:03:36.973087 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:36.973016    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" containerID="cri-o://d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de" gracePeriod=30
Sep 10 11:03:37.118418 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:37.118371    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:03:37.118681 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:37.118657    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry" containerID="cri-o://25e4c2a604b45dfcff66ef2abf6355e2cb939921b9657dda1c75c3810442d81d" gracePeriod=30
Sep 10 11:03:37.118795 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:37.118761    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline" containerID="cri-o://4c3ba90697b5e41b2153f54f7973ca66e8598a92ac2f88d8ea857886122fb500" gracePeriod=30
Sep 10 11:03:37.118919 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:37.118770    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" containerID="cri-o://2ecdff0dc23a4703aa1a426f5108c417726f67de793a9e220611bf439ac92647" gracePeriod=30
Sep 10 11:03:37.118919 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:37.118824    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" containerID="cri-o://56a5d53e39977030889ad3ead1143825d60bab386a60733da8ecefa62071713a" gracePeriod=30
Sep 10 11:03:38.595796 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.595764    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerID="d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de" exitCode=0
Sep 10 11:03:38.596193 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.595832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"}
Sep 10 11:03:38.598580 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.598561    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="2ecdff0dc23a4703aa1a426f5108c417726f67de793a9e220611bf439ac92647" exitCode=0
Sep 10 11:03:38.598580 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.598579    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="56a5d53e39977030889ad3ead1143825d60bab386a60733da8ecefa62071713a" exitCode=0
Sep 10 11:03:38.598721 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.598597    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"2ecdff0dc23a4703aa1a426f5108c417726f67de793a9e220611bf439ac92647"}
Sep 10 11:03:38.598721 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:38.598625    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"56a5d53e39977030889ad3ead1143825d60bab386a60733da8ecefa62071713a"}
Sep 10 11:03:42.923822 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:42.923776    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Sep 10 11:03:42.924288 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:42.923814    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 10 11:03:44.218319 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:44.218273    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 10 11:03:46.947450 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:46.947402    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": context deadline exceeded"
Sep 10 11:03:52.923713 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:52.923669    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Sep 10 11:03:52.924173 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:52.923679    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 10 11:03:54.218154 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:54.218105    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 10 11:03:56.946642 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:56.946586    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": context deadline exceeded"
Sep 10 11:03:56.947033 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:03:56.946738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:04:02.923834 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:02.923785    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 10 11:04:02.923834 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:02.923790    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Sep 10 11:04:02.924338 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:02.923963    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:04:02.924338 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:02.924031    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:04:04.217772 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:04.217725    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 10 11:04:04.218169 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:04.217852    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:04:06.946807 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:06.946751    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 10 11:04:07.610104 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.610084    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:04:07.712886 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.712850    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerID="f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55" exitCode=137
Sep 10 11:04:07.712886 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.712882    2583 generic.go:356] "Generic (PLEG): container finished" podID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerID="de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8" exitCode=137
Sep 10 11:04:07.713133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.712920    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"
Sep 10 11:04:07.713133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.712942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"}
Sep 10 11:04:07.713133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.712995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"}
Sep 10 11:04:07.713133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.713014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4" event={"ID":"e1875b63-76ae-460b-9fc5-0d1f69afd97f","Type":"ContainerDied","Data":"f48231654c63bcdc66af1eddb329a53d5b1f4b9ef911075fef1090488e7810c9"}
Sep 10 11:04:07.713133 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.713048    2583 scope.go:117] "RemoveContainer" containerID="d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"
Sep 10 11:04:07.716318 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.716291    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="4c3ba90697b5e41b2153f54f7973ca66e8598a92ac2f88d8ea857886122fb500" exitCode=137
Sep 10 11:04:07.716318 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.716317    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerID="25e4c2a604b45dfcff66ef2abf6355e2cb939921b9657dda1c75c3810442d81d" exitCode=137
Sep 10 11:04:07.716489 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.716357    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"4c3ba90697b5e41b2153f54f7973ca66e8598a92ac2f88d8ea857886122fb500"}
Sep 10 11:04:07.716489 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.716411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"25e4c2a604b45dfcff66ef2abf6355e2cb939921b9657dda1c75c3810442d81d"}
Sep 10 11:04:07.723686 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.723669    2583 scope.go:117] "RemoveContainer" containerID="f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"
Sep 10 11:04:07.731137 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.731122    2583 scope.go:117] "RemoveContainer" containerID="de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"
Sep 10 11:04:07.738424 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.738407    2583 scope.go:117] "RemoveContainer" containerID="20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"
Sep 10 11:04:07.746205 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.746171    2583 scope.go:117] "RemoveContainer" containerID="56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"
Sep 10 11:04:07.748486 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748461    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.748595 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.748595 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748571    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.748702 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z44hc\" (UniqueName: \"kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.748702 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.748702 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.748685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls\") pod \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\" (UID: \"e1875b63-76ae-460b-9fc5-0d1f69afd97f\") "
Sep 10 11:04:07.749124 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.749096    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data" (OuterVolumeSpecName: "feast-data") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:04:07.749224 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.749147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 11:04:07.751081 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.751030    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc" (OuterVolumeSpecName: "kube-api-access-z44hc") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "kube-api-access-z44hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:04:07.751181 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.751103    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls" (OuterVolumeSpecName: "online-tls") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.751181 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.751147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.751279 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.751237    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e1875b63-76ae-460b-9fc5-0d1f69afd97f" (UID: "e1875b63-76ae-460b-9fc5-0d1f69afd97f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.754720 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.754706    2583 scope.go:117] "RemoveContainer" containerID="d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"
Sep 10 11:04:07.754987 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:04:07.754958    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de\": container with ID starting with d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de not found: ID does not exist" containerID="d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"
Sep 10 11:04:07.755049 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.754993    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"} err="failed to get container status \"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de\": rpc error: code = NotFound desc = could not find container \"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de\": container with ID starting with d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de not found: ID does not exist"
Sep 10 11:04:07.755049 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755010    2583 scope.go:117] "RemoveContainer" containerID="f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"
Sep 10 11:04:07.755264 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:04:07.755245    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55\": container with ID starting with f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55 not found: ID does not exist" containerID="f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"
Sep 10 11:04:07.755304 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755270    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"} err="failed to get container status \"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55\": rpc error: code = NotFound desc = could not find container \"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55\": container with ID starting with f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55 not found: ID does not exist"
Sep 10 11:04:07.755304 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755284    2583 scope.go:117] "RemoveContainer" containerID="de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"
Sep 10 11:04:07.755600 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:04:07.755579    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8\": container with ID starting with de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8 not found: ID does not exist" containerID="de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"
Sep 10 11:04:07.755685 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755601    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"} err="failed to get container status \"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8\": rpc error: code = NotFound desc = could not find container \"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8\": container with ID starting with de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8 not found: ID does not exist"
Sep 10 11:04:07.755685 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755616    2583 scope.go:117] "RemoveContainer" containerID="20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"
Sep 10 11:04:07.755844 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:04:07.755829    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc\": container with ID starting with 20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc not found: ID does not exist" containerID="20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"
Sep 10 11:04:07.755882 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755847    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"} err="failed to get container status \"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc\": rpc error: code = NotFound desc = could not find container \"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc\": container with ID starting with 20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc not found: ID does not exist"
Sep 10 11:04:07.755882 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.755858    2583 scope.go:117] "RemoveContainer" containerID="56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"
Sep 10 11:04:07.756079 ip-10-0-133-250 kubenswrapper[2583]: E0910 11:04:07.756063    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198\": container with ID starting with 56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198 not found: ID does not exist" containerID="56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"
Sep 10 11:04:07.756116 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756081    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"} err="failed to get container status \"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198\": rpc error: code = NotFound desc = could not find container \"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198\": container with ID starting with 56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198 not found: ID does not exist"
Sep 10 11:04:07.756116 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756094    2583 scope.go:117] "RemoveContainer" containerID="d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"
Sep 10 11:04:07.756318 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756302    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de"} err="failed to get container status \"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de\": rpc error: code = NotFound desc = could not find container \"d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de\": container with ID starting with d9a41e3146d387ccb0b0c3cfcf377aedf30c330c1d3925ebad6fc216404528de not found: ID does not exist"
Sep 10 11:04:07.756318 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756317    2583 scope.go:117] "RemoveContainer" containerID="f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"
Sep 10 11:04:07.756578 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756552    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55"} err="failed to get container status \"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55\": rpc error: code = NotFound desc = could not find container \"f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55\": container with ID starting with f47ad75330e1ef5bc1ac795505abb8f5440fda6a910982938fed9dbdcaa88d55 not found: ID does not exist"
Sep 10 11:04:07.756578 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756573    2583 scope.go:117] "RemoveContainer" containerID="de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"
Sep 10 11:04:07.756781 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756766    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8"} err="failed to get container status \"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8\": rpc error: code = NotFound desc = could not find container \"de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8\": container with ID starting with de64e89fc80be4572b791dea6a38eb76eef944d2d639213ca3702940d519cfe8 not found: ID does not exist"
Sep 10 11:04:07.756781 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756780    2583 scope.go:117] "RemoveContainer" containerID="20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"
Sep 10 11:04:07.757006 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.756989    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc"} err="failed to get container status \"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc\": rpc error: code = NotFound desc = could not find container \"20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc\": container with ID starting with 20064a70373bca423ad4f9e460340f2bb7f3bff80abdbb801461891227891edc not found: ID does not exist"
Sep 10 11:04:07.757062 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.757006    2583 scope.go:117] "RemoveContainer" containerID="56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"
Sep 10 11:04:07.757216 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.757201    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198"} err="failed to get container status \"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198\": rpc error: code = NotFound desc = could not find container \"56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198\": container with ID starting with 56fdb7625fbff817257c5b3eebeb36ee545c462552b8e5ed5d45e2cb3b724198 not found: ID does not exist"
Sep 10 11:04:07.757503 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.757488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:04:07.849914 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.849885    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzvh7\" (UniqueName: \"kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850042 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.849926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850042 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.849944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850042 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.849967    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850208 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850038    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850208 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850091    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data\") pod \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\" (UID: \"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2\") "
Sep 10 11:04:07.850319 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850305    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1875b63-76ae-460b-9fc5-0d1f69afd97f-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850327    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z44hc\" (UniqueName: \"kubernetes.io/projected/e1875b63-76ae-460b-9fc5-0d1f69afd97f-kube-api-access-z44hc\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850342    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850355    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850367    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e1875b63-76ae-460b-9fc5-0d1f69afd97f-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850401    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1875b63-76ae-460b-9fc5-0d1f69afd97f-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.850938 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.850910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data" (OuterVolumeSpecName: "feast-data") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 11:04:07.851991 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.851963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.852434 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.852418    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.852506 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.852440    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7" (OuterVolumeSpecName: "kube-api-access-pzvh7") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "kube-api-access-pzvh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 11:04:07.852544 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.852503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls" (OuterVolumeSpecName: "online-tls") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.852793 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.852777    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" (UID: "ac5bfe59-6b01-47cf-873f-7a4b3e133ea2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 11:04:07.951096 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951073    2583 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-offline-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.951096 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951094    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.951405 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951103    2583 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-online-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.951405 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951112    2583 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-ui-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.951405 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951119    2583 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-feast-data\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:07.951405 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:07.951127    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzvh7\" (UniqueName: \"kubernetes.io/projected/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2-kube-api-access-pzvh7\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\""
Sep 10 11:04:08.032216 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.032132    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:04:08.035748 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.035722    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2pnt4"]
Sep 10 11:04:08.722956 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.722916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn" event={"ID":"ac5bfe59-6b01-47cf-873f-7a4b3e133ea2","Type":"ContainerDied","Data":"afcb438a4bac9632c9609fe2140f94a11a4b9030ee5e79eec33a216fc8c24dc0"}
Sep 10 11:04:08.723120 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.722968    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"
Sep 10 11:04:08.723120 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.722983    2583 scope.go:117] "RemoveContainer" containerID="2ecdff0dc23a4703aa1a426f5108c417726f67de793a9e220611bf439ac92647"
Sep 10 11:04:08.730693 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.730674    2583 scope.go:117] "RemoveContainer" containerID="4c3ba90697b5e41b2153f54f7973ca66e8598a92ac2f88d8ea857886122fb500"
Sep 10 11:04:08.737683 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.737666    2583 scope.go:117] "RemoveContainer" containerID="56a5d53e39977030889ad3ead1143825d60bab386a60733da8ecefa62071713a"
Sep 10 11:04:08.744758 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.744737    2583 scope.go:117] "RemoveContainer" containerID="25e4c2a604b45dfcff66ef2abf6355e2cb939921b9657dda1c75c3810442d81d"
Sep 10 11:04:08.751629 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.751613    2583 scope.go:117] "RemoveContainer" containerID="7ff1c09468cc169fdd95e839b4087469fa80f0aa67746ca5a5d31b911f74a421"
Sep 10 11:04:08.755307 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.755286    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:04:08.758724 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.758709    2583 scope.go:117] "RemoveContainer" containerID="3b3792d0b2d4af3ce8296e18b94fb18a900ebeab68b3c219a750d51679fb5902"
Sep 10 11:04:08.761512 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:08.761493    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hj5dn"]
Sep 10 11:04:09.918629 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:09.918595    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" path="/var/lib/kubelet/pods/ac5bfe59-6b01-47cf-873f-7a4b3e133ea2/volumes"
Sep 10 11:04:09.919193 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:09.919179    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" path="/var/lib/kubelet/pods/e1875b63-76ae-460b-9fc5-0d1f69afd97f/volumes"
Sep 10 11:04:41.911023 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:41.910994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 11:04:41.912504 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:41.912484    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 11:04:44.912989 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.912946    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s64x/must-gather-7nnwm"]
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913270    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="feast-apply"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913284    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="feast-apply"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913295    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913301    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913311    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913316    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913321    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913326    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913334    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="feast-apply"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913339    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="feast-apply"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913346    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="feast-init"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913351    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="feast-init"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913360    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913367    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913375    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui"
Sep 10 11:04:44.913373 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913394    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913404    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913412    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913418    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="feast-init"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913423    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="feast-init"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913434    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913441    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913487    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="offline"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913496    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="ui"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913503    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="ui"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913509    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="offline"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913516    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="registry"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913525    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1875b63-76ae-460b-9fc5-0d1f69afd97f" containerName="online"
Sep 10 11:04:44.913931 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.913533    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5bfe59-6b01-47cf-873f-7a4b3e133ea2" containerName="online"
Sep 10 11:04:44.916408 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.916373    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:44.918863 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.918834    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s64x\"/\"openshift-service-ca.crt\""
Sep 10 11:04:44.918863 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.918855    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s64x\"/\"kube-root-ca.crt\""
Sep 10 11:04:44.919837 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.919821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9s64x\"/\"default-dockercfg-lqd5z\""
Sep 10 11:04:44.924649 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.924627    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/must-gather-7nnwm"]
Sep 10 11:04:44.930308 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.930290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w24k\" (UniqueName: \"kubernetes.io/projected/435b1fac-aa14-434c-a394-10648b8d1b46-kube-api-access-6w24k\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:44.930427 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:44.930334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/435b1fac-aa14-434c-a394-10648b8d1b46-must-gather-output\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.030792 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.030763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/435b1fac-aa14-434c-a394-10648b8d1b46-must-gather-output\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.030957 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.030815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w24k\" (UniqueName: \"kubernetes.io/projected/435b1fac-aa14-434c-a394-10648b8d1b46-kube-api-access-6w24k\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.031096 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.031076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/435b1fac-aa14-434c-a394-10648b8d1b46-must-gather-output\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.042016 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.041991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w24k\" (UniqueName: \"kubernetes.io/projected/435b1fac-aa14-434c-a394-10648b8d1b46-kube-api-access-6w24k\") pod \"must-gather-7nnwm\" (UID: \"435b1fac-aa14-434c-a394-10648b8d1b46\") " pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.225532 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.225477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/must-gather-7nnwm"
Sep 10 11:04:45.495574 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.495494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/must-gather-7nnwm"]
Sep 10 11:04:45.498494 ip-10-0-133-250 kubenswrapper[2583]: W0910 11:04:45.498465    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod435b1fac_aa14_434c_a394_10648b8d1b46.slice/crio-dee70f079a04ed34732aff29493a64e0e91f7e9493c37a62a443620f4fb11ca5 WatchSource:0}: Error finding container dee70f079a04ed34732aff29493a64e0e91f7e9493c37a62a443620f4fb11ca5: Status 404 returned error can't find the container with id dee70f079a04ed34732aff29493a64e0e91f7e9493c37a62a443620f4fb11ca5
Sep 10 11:04:45.500195 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.500179    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 11:04:45.862192 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:45.862115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/must-gather-7nnwm" event={"ID":"435b1fac-aa14-434c-a394-10648b8d1b46","Type":"ContainerStarted","Data":"dee70f079a04ed34732aff29493a64e0e91f7e9493c37a62a443620f4fb11ca5"}
Sep 10 11:04:46.870185 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:46.870150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/must-gather-7nnwm" event={"ID":"435b1fac-aa14-434c-a394-10648b8d1b46","Type":"ContainerStarted","Data":"072a80ca6db27536721e2b394b2fc8097538706e59aa8b2a8ca02796db1c3257"}
Sep 10 11:04:46.870599 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:46.870193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/must-gather-7nnwm" event={"ID":"435b1fac-aa14-434c-a394-10648b8d1b46","Type":"ContainerStarted","Data":"b61933ded1c2091bdceacb61a4b0039da9a6aa4b6af35988af3558026f5f8ae9"}
Sep 10 11:04:46.887070 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:46.886967    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9s64x/must-gather-7nnwm" podStartSLOduration=2.020556167 podStartE2EDuration="2.886947095s" totalImagesPullingTime="866.390928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:04:46.88602138 +0000 UTC m=+1805.453501996" watchObservedRunningTime="2026-09-10 11:04:46.886947095 +0000 UTC m=+1805.454427728"
Sep 10 11:04:47.765120 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:47.765065    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lr2sm_e1723f71-9ccf-43ab-9ed4-40b79714af8d/global-pull-secret-syncer/0.log"
Sep 10 11:04:47.883700 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:47.883663    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pbtrf_32124561-b8d1-42d5-90c6-d8883c93a263/konnectivity-agent/0.log"
Sep 10 11:04:47.929337 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:47.929301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-250.ec2.internal_ccb165d55e894605f0ca2c828f2460a9/haproxy/0.log"
Sep 10 11:04:51.656357 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.656302    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/alertmanager/0.log"
Sep 10 11:04:51.683926 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.683872    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/config-reloader/0.log"
Sep 10 11:04:51.710034 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.709899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/kube-rbac-proxy-web/0.log"
Sep 10 11:04:51.736830 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.736792    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/kube-rbac-proxy/0.log"
Sep 10 11:04:51.763400 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.763355    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/kube-rbac-proxy-metric/0.log"
Sep 10 11:04:51.795533 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.795331    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/prom-label-proxy/0.log"
Sep 10 11:04:51.824198 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:51.824149    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a5a0987-1740-45e0-ad38-5df46c444551/init-config-reloader/0.log"
Sep 10 11:04:52.125749 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.125713    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqvg_a82b243a-767d-4ebd-8fb7-31164db854db/node-exporter/0.log"
Sep 10 11:04:52.149438 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.149406    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqvg_a82b243a-767d-4ebd-8fb7-31164db854db/kube-rbac-proxy/0.log"
Sep 10 11:04:52.174033 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.173987    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqvg_a82b243a-767d-4ebd-8fb7-31164db854db/init-textfile/0.log"
Sep 10 11:04:52.645332 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.645295    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-zm666_0608005a-8bae-44c3-82e0-7c29ffd496a5/prometheus-operator-admission-webhook/0.log"
Sep 10 11:04:52.692565 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.692531    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9799f5d8-xdnnj_42b911ee-da27-43f5-8957-97c68229cb35/telemeter-client/0.log"
Sep 10 11:04:52.726171 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.726138    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9799f5d8-xdnnj_42b911ee-da27-43f5-8957-97c68229cb35/reload/0.log"
Sep 10 11:04:52.766271 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:52.766238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b9799f5d8-xdnnj_42b911ee-da27-43f5-8957-97c68229cb35/kube-rbac-proxy/0.log"
Sep 10 11:04:54.081265 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:54.081236    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-d9nkz_2f8524d2-44e4-4efa-8d20-6a59c5d16c36/networking-console-plugin/0.log"
Sep 10 11:04:54.945222 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:54.945187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849d646b67-87psm_84388eb9-e40a-451b-9b00-792e0ee3586b/console/0.log"
Sep 10 11:04:55.086264 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.086218    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"]
Sep 10 11:04:55.089734 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.089711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.099794 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.099771    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"]
Sep 10 11:04:55.220204 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.220109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-sys\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.220495 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.220468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-lib-modules\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.220677 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.220658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-podres\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.220827 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.220811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-proc\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.220961 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.220946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qf2k\" (UniqueName: \"kubernetes.io/projected/9dae2f89-6b97-4431-9c0f-a278b538020d-kube-api-access-8qf2k\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321712 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-lib-modules\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321893 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-podres\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321893 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-proc\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321893 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qf2k\" (UniqueName: \"kubernetes.io/projected/9dae2f89-6b97-4431-9c0f-a278b538020d-kube-api-access-8qf2k\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321893 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-sys\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.321893 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-podres\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.322099 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-lib-modules\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.322099 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-proc\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.322099 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.321927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dae2f89-6b97-4431-9c0f-a278b538020d-sys\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.331723 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.331688    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qf2k\" (UniqueName: \"kubernetes.io/projected/9dae2f89-6b97-4431-9c0f-a278b538020d-kube-api-access-8qf2k\") pod \"perf-node-gather-daemonset-9mg99\" (UID: \"9dae2f89-6b97-4431-9c0f-a278b538020d\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.400326 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.400290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.683672 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.683581    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"]
Sep 10 11:04:55.686665 ip-10-0-133-250 kubenswrapper[2583]: W0910 11:04:55.686625    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9dae2f89_6b97_4431_9c0f_a278b538020d.slice/crio-3b7cabf7afc3cd54f2c8a1b0a89b74108d0e55a7f536c03ac710e62d60e8f47b WatchSource:0}: Error finding container 3b7cabf7afc3cd54f2c8a1b0a89b74108d0e55a7f536c03ac710e62d60e8f47b: Status 404 returned error can't find the container with id 3b7cabf7afc3cd54f2c8a1b0a89b74108d0e55a7f536c03ac710e62d60e8f47b
Sep 10 11:04:55.920107 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.920079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:04:55.920266 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.920124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99" event={"ID":"9dae2f89-6b97-4431-9c0f-a278b538020d","Type":"ContainerStarted","Data":"b6fdb9b8dbcdccc57d98933ec57f5be610da4996862d0066cba79531cc1e09dd"}
Sep 10 11:04:55.920266 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.920142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99" event={"ID":"9dae2f89-6b97-4431-9c0f-a278b538020d","Type":"ContainerStarted","Data":"3b7cabf7afc3cd54f2c8a1b0a89b74108d0e55a7f536c03ac710e62d60e8f47b"}
Sep 10 11:04:55.934516 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:55.934426    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99" podStartSLOduration=0.934410189 podStartE2EDuration="934.410189ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:04:55.933581101 +0000 UTC m=+1814.501061760" watchObservedRunningTime="2026-09-10 11:04:55.934410189 +0000 UTC m=+1814.501890803"
Sep 10 11:04:56.345482 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:56.345404    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5d8r_81a2db82-e9d7-498f-9e64-959384efcd45/dns/0.log"
Sep 10 11:04:56.370644 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:56.370611    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5d8r_81a2db82-e9d7-498f-9e64-959384efcd45/kube-rbac-proxy/0.log"
Sep 10 11:04:56.475486 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:56.475454    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qs9j_4dc14834-1f7a-4d8d-8a76-666d384f4857/dns-node-resolver/0.log"
Sep 10 11:04:56.976105 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:56.976050    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqk2p_156d5bf9-fbbf-4bed-842d-cbd047424433/node-ca/0.log"
Sep 10 11:04:58.024930 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:58.024893    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbb8r_2bbc6d4c-f9b6-4e05-8830-59f6b6ca3a95/serve-healthcheck-canary/0.log"
Sep 10 11:04:58.536354 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:58.536326    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgn5m_91dde24f-34bd-4b2a-8779-8d429b7e56ed/kube-rbac-proxy/0.log"
Sep 10 11:04:58.559336 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:58.559269    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgn5m_91dde24f-34bd-4b2a-8779-8d429b7e56ed/exporter/0.log"
Sep 10 11:04:58.581463 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:04:58.581438    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dgn5m_91dde24f-34bd-4b2a-8779-8d429b7e56ed/extractor/0.log"
Sep 10 11:05:01.928442 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:01.928416    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-9mg99"
Sep 10 11:05:02.566681 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:02.566637    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hklp5_6f9c19fb-b893-41c9-a51a-cdef33d180ee/migrator/0.log"
Sep 10 11:05:02.588124 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:02.588100    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hklp5_6f9c19fb-b893-41c9-a51a-cdef33d180ee/graceful-termination/0.log"
Sep 10 11:05:04.131938 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.131854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/kube-multus-additional-cni-plugins/0.log"
Sep 10 11:05:04.161076 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.161046    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/egress-router-binary-copy/0.log"
Sep 10 11:05:04.186056 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.186032    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/cni-plugins/0.log"
Sep 10 11:05:04.209434 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.209406    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/bond-cni-plugin/0.log"
Sep 10 11:05:04.237280 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.237253    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/routeoverride-cni/0.log"
Sep 10 11:05:04.260698 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.260674    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/whereabouts-cni-bincopy/0.log"
Sep 10 11:05:04.281990 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.281964    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfwcd_4439fa18-fa8d-42a7-a0fa-734a4ee2e202/whereabouts-cni/0.log"
Sep 10 11:05:04.316953 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.316900    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bzwhf_2c5c1c85-1eaf-4415-b9bd-98319999c939/kube-multus/0.log"
Sep 10 11:05:04.498934 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.498904    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wp72z_f059301e-f05c-462f-9a6c-85ced79f641a/network-metrics-daemon/0.log"
Sep 10 11:05:04.520125 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:04.520097    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wp72z_f059301e-f05c-462f-9a6c-85ced79f641a/kube-rbac-proxy/0.log"
Sep 10 11:05:05.194629 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.194598    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-controller/0.log"
Sep 10 11:05:05.216548 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.216520    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/1.log"
Sep 10 11:05:05.216699 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.216528    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovn-acl-logging/0.log"
Sep 10 11:05:05.234702 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.234669    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/kube-rbac-proxy-node/0.log"
Sep 10 11:05:05.261998 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.261963    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 11:05:05.291075 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.291049    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/northd/0.log"
Sep 10 11:05:05.316952 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.316922    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/nbdb/0.log"
Sep 10 11:05:05.344348 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.344314    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/sbdb/0.log"
Sep 10 11:05:05.392003 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:05.391976    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpttd_1ac419bf-6e1c-482a-82dd-e6eb69c9ab44/ovnkube-controller/0.log"
Sep 10 11:05:06.825474 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:06.825444    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-txgnh_2101398d-73f4-4b14-93ec-87ee7f493b6f/network-check-target-container/0.log"
Sep 10 11:05:07.766306 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:07.766275    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qgjfr_568336b8-6cda-4eeb-848e-038b5cc0b826/iptables-alerter/0.log"
Sep 10 11:05:08.515301 ip-10-0-133-250 kubenswrapper[2583]: I0910 11:05:08.515270    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5dnr2_0fad096d-70d3-4c30-91c4-68ec759cdf56/tuned/0.log"