Jul 20 15:33:51.341031 ip-10-0-140-218 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 15:33:52.255325 ip-10-0-140-218 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:33:52.255325 ip-10-0-140-218 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 15:33:52.255325 ip-10-0-140-218 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:33:52.255325 ip-10-0-140-218 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 15:33:52.255325 ip-10-0-140-218 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:33:52.256499 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.256409    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262647    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262666    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262670    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262674    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262676    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262679    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.262672 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262682    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262685    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262688    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262691    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262694    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262697    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262699    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262702    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262704    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262707    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262709    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262712    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262715    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262717    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262720    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262733    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262738    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262741    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262744    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.262930 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262761    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262765    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262767    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262770    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262773    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262775    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262778    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262781    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262783    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262786    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262789    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262791    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262794    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262796    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262799    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262803    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262805    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262808    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262811    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262813    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.263403 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262816    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262819    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262821    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262824    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262827    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262830    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262833    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262835    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262838    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262841    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262845    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262848    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262850    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262852    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262855    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262857    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262860    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262862    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262865    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.263889 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262868    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262870    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262873    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262875    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262879    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262882    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262884    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262887    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262890    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262894    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262898    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262901    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262905    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262909    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262912    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262914    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262917    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262920    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262923    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.264329 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262926    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262928    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262931    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262934    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262936    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262939    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262942    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262945    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262948    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262950    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262953    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262955    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262958    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262961    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262964    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.264817 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.262967    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.266407 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266394    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.266407 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266407    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266411    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266414    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266417    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266420    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266423    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266426    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266429    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266431    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266435    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266438    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266440    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266443    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266446    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266448    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266452    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266457    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266460    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266463    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266466    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.266468 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266469    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266472    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266475    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266478    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266480    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266483    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266486    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266489    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266492    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266494    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266497    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266499    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266502    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266504    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266507    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266509    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266512    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266514    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266517    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.266969 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266519    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266522    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266524    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266527    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266531    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266535    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266538    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266541    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266543    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266546    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266549    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266552    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266554    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266557    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266560    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266563    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266565    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266568    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266571    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266573    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.267458 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266576    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266579    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266581    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266584    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266588    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266591    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266594    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266597    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266600    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266603    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266606    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266609    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266613    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266615    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266618    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266621    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266624    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266626    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266629    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266634    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.267961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266636    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266639    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266642    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266645    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266647    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266650    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266653    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266656    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266659    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266661    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266664    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266667    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266669    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266672    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266674    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266677    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266680    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266682    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.266685    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267074    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.268429 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267079    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267082    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267085    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267087    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267090    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267092    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267095    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267098    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267100    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267103    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267108    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267111    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267114    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267117    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267120    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267124    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267127    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267130    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267133    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.268935 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267136    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267138    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267142    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267145    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267147    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267150    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267153    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267155    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267157    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267160    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267162    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267165    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267167    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267170    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267172    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267175    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267178    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267181    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267183    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267186    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.269438 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267188    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267191    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267193    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267196    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267198    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267201    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267203    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267205    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267208    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267211    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267214    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267216    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267219    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267222    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267224    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267227    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267229    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267232    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267236    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267239    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.269926 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267241    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267244    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267246    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267248    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267251    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267253    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267256    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267258    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267261    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267263    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267265    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267268    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267270    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267274    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267277    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267280    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267283    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267285    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267288    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.270397 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267290    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267293    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267295    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267298    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267301    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267304    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267306    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267309    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267312    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267314    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267317    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267319    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267322    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267334    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267337    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267340    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267342    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267345    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267348    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.267350    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.270856 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267422    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267429    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267436    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267441    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267445    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267448    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267453    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267457    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267460    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267463    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267467    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267470    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267473    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267476    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267479    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267482    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267486    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267489    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267494    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267497    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267500    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267503    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267506    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267510    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 15:33:52.271334 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267513    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267516    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267519    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267522    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267525    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267528    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267531    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267533    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267537    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267540    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267543    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267546    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267549    2558 flags.go:64] FLAG: --enable-server="true"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267552    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267564    2558 flags.go:64] FLAG: --event-burst="100"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267567    2558 flags.go:64] FLAG: --event-qps="50"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267569    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267572    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267575    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267584    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267587    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267590    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267592    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267596    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267599    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 15:33:52.271908 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267602    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267605    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267609    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267611    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267614    2558 flags.go:64] FLAG: --feature-gates=""
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267622    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267625    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267628    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267631    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267634    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267637    2558 flags.go:64] FLAG: --help="false"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267640    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267643    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267646    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267649    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267652    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267655    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267658    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267661    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267664    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267666    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267669    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267673    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267676    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 20 15:33:52.272554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267678    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267681    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267684    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267687    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267690    2558 flags.go:64] FLAG: --lock-file=""
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267693    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267700    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267704    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267709    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267712    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267715    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267718    2558 flags.go:64] FLAG: --logging-format="text"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267721    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267724    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267727    2558 flags.go:64] FLAG: --manifest-url=""
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267730    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267734    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267737    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267741    2558 flags.go:64] FLAG: --max-pods="110"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267744    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267759    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267762    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267764    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267767    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267770    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 15:33:52.273159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267773    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267781    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267784    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267787    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267790    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267793    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267798    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267801    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267804    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267808    2558 flags.go:64] FLAG: --port="10250"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267811    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267814    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06a06861e2bb0e801"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267817    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267820    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267824    2558 flags.go:64] FLAG: --register-node="true"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267827    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267830    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267836    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267839    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267842    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267846    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267849    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267852    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267857    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267860    2558 flags.go:64] FLAG: --runonce="false"
Jul 20 15:33:52.273808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267863    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267866    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267869    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267872    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267875    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267878    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267881    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267884    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267886    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267889    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267892    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267895    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267898    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267900    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267903    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267908    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267911    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267913    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267917    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267920    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267923    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267927    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267930    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267933    2558 flags.go:64] FLAG: --v="2"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267937    2558 flags.go:64] FLAG: --version="false"
Jul 20 15:33:52.274387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267942    2558 flags.go:64] FLAG: --vmodule=""
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267946    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.267949    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268064    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268068    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268071    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268074    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268077    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268080    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268082    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268084    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268087    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268090    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268092    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268095    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268097    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268100    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268102    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268105    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.275012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268107    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268110    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268113    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268116    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268118    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268121    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268123    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268126    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268129    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268133    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268135    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268138    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268140    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268143    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268146    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268149    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268152    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268154    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268158    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268161    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.275465 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268163    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268166    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268169    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268173    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268176    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268179    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268181    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268184    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268186    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268189    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268192    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268194    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268196    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268199    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268201    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268205    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268209    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268212    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268215    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.276085 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268218    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268221    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268225    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268228    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268231    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268234    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268236    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268240    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268244    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268247    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268250    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268254    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268257    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268260    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268263    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268266    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268269    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268271    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268274    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268277    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.276523 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268280    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268283    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268286    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268289    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268292    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268295    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268298    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268301    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268304    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268307    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268309    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268312    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268315    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268317    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268321    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268324    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268327    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268329    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268333    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268335    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.277031 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268338    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268341    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268343    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.268347    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.268353    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.275359    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.275374    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.276094    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.276105    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276166    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276172    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276175    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276178    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276182    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276185    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.277497 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276187    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276190    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276193    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276196    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276199    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276201    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276204    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276207    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276209    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276212    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276214    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276217    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276220    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276223    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276225    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276228    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276232    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276236    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276245    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.277874 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276248    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276251    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276254    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276258    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276261    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276264    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276267    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276269    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276272    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276275    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276277    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276280    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276282    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276285    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276288    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276291    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276293    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276296    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276298    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276301    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.278330 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276304    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276306    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276309    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276311    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276314    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276316    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276319    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276321    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276324    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276326    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276329    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276331    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276334    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276337    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276339    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276342    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276345    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276348    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276351    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276354    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.278808 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276356    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276359    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276362    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276364    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276367    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276369    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276372    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276374    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276376    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276379    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276382    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276384    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276387    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276390    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276393    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276395    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276398    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276402    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276405    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276408    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.279311 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276410    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276413    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276416    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276418    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276422    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276426    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276429    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276432    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276435    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276438    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276440    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276443    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276446    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276448    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.276453    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:33:52.279783 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276580    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276584    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276587    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276590    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276593    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276595    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276599    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276602    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276605    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276608    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276611    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276614    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276617    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276619    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276622    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276624    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276627    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276629    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276632    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276634    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:33:52.280169 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276637    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276639    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276653    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276656    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276659    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276661    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276664    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276667    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276669    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276672    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276675    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276677    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276680    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276683    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276685    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276688    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276690    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276693    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276697    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:33:52.280637 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276700    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276703    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276705    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276708    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276711    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276714    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276717    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276719    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276722    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276725    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276727    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276731    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276734    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276737    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276740    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276743    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276746    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276761    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276764    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276767    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:33:52.281104 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276770    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276772    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276775    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276777    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276780    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276783    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276785    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276788    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276791    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276793    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276796    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276798    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276801    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276803    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276806    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276808    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276811    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276814    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276818    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:33:52.281617 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276821    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276823    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276826    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276828    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276831    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276834    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276836    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276839    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276841    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276845    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276847    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276850    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276853    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276856    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276858    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276860    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276863    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276865    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276868    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276870    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:33:52.282131 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:52.276873    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.276877    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.276983    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.278833    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.279880    2558 server.go:1019] "Starting client certificate rotation"
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.279977    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.280008    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 15:33:52.282627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.282274    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 15:33:52.283775 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.283743    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 15:33:52.295300 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.295252    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 20 15:33:52.297695 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.297677    2558 log.go:25] "Validated CRI v1 image API"
Jul 20 15:33:52.298479 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.298464    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 15:33:52.302235 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.302215    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 baae82b0-4b9b-4f60-8e1b-63571b856b0b:/dev/nvme0n1p4 f7c3b72e-7b02-48a9-b868-f3ec59ef8569:/dev/nvme0n1p3]
Jul 20 15:33:52.302333 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.302234    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 15:33:52.308155 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.308040    2558 manager.go:216] Machine: {Timestamp:2026-07-20 15:33:52.30595779 +0000 UTC m=+0.847685465 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102863 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29357935c288e52853e8f3dcc67849 SystemUUID:ec293579-35c2-88e5-2853-e8f3dcc67849 BootID:d8ee1b88-960f-4e7e-a993-c51b0bec3db0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:d1:c8:c8:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:d1:c8:c8:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:58:84:6a:8b:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 15:33:52.308155 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.308147    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 15:33:52.308316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.308256    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 15:33:52.311000 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.310978    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 15:33:52.311128 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.311002    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 15:33:52.312104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.312092    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 15:33:52.312153 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.312109    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 15:33:52.312153 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.312121    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 15:33:52.312720 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.312708    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 15:33:52.313896 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.313880    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 15:33:52.315691 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.315673    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 15:33:52.317192 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317180    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 15:33:52.317316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317306    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 15:33:52.317362 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317336    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 15:33:52.317362 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317347    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 15:33:52.317362 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317362    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 15:33:52.317471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317371    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 20 15:33:52.317471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317380    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 15:33:52.317740 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317728    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 15:33:52.317794 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.317768    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 15:33:52.320685 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.320671    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 15:33:52.322226 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.322214    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 15:33:52.322286 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.322243    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 15:33:52.323470 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323460    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323476    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323482    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323488    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323497    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323502    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 15:33:52.323509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323510    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 15:33:52.323666 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323516    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 15:33:52.323666 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323522    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 15:33:52.323666 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323527    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 15:33:52.323666 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323535    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 15:33:52.323666 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.323547    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 15:33:52.324298 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.324288    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 15:33:52.324298 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.324298    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 15:33:52.327259 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.327246    2558 server.go:1268] "Started kubelet"
Jul 20 15:33:52.327400 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.327354    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 15:33:52.327467 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.327455    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 15:33:52.327536 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.327512    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 15:33:52.328023 ip-10-0-140-218 systemd[1]: Started Kubernetes Kubelet.
Jul 20 15:33:52.329071 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.329018    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 15:33:52.329844 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.329820    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 15:33:52.333141 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.333116    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 15:33:52.333791 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.333742    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 15:33:52.333901 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.333867    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 15:33:52.335630 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.334801    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-218.ec2.internal.18c409597ea7d655  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-218.ec2.internal,UID:ip-10-0-140-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-218.ec2.internal,},FirstTimestamp:2026-07-20 15:33:52.327226965 +0000 UTC m=+0.868954640,LastTimestamp:2026-07-20 15:33:52.327226965 +0000 UTC m=+0.868954640,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-218.ec2.internal,}"
Jul 20 15:33:52.336187 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.336158    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 15:33:52.338422 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.338403    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 15:33:52.338528 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.338419    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 15:33:52.338789 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.338770    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.339031 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339016    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 15:33:52.339103 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339033    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 15:33:52.339103 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339061    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 15:33:52.339184 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339142    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 15:33:52.339184 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339150    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 15:33:52.339335 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339316    2558 factory.go:55] Registering systemd factory
Jul 20 15:33:52.339388 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339341    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 20 15:33:52.339570 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339554    2558 factory.go:153] Registering CRI-O factory
Jul 20 15:33:52.339656 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339572    2558 factory.go:223] Registration of the crio container factory successfully
Jul 20 15:33:52.339656 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339623    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 15:33:52.339656 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339648    2558 factory.go:103] Registering Raw factory
Jul 20 15:33:52.339817 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.339661    2558 manager.go:1196] Started watching for new ooms in manager
Jul 20 15:33:52.340081 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.340065    2558 manager.go:349] Starting recovery of all containers
Jul 20 15:33:52.347600 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.347551    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 15:33:52.349955 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.349936    2558 manager.go:354] Recovery completed
Jul 20 15:33:52.351255 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.351215    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 15:33:52.351353 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.351286    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 15:33:52.354777 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.354763    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.356459 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.356434    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.356520 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.356484    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.356520 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.356495    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.357019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357004    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 15:33:52.357019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357017    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 15:33:52.357141 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357031    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 15:33:52.357141 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357048    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.357741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357728    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.357806 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357764    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.357806 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.357775    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.358207 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.358196    2558 policy_none.go:49] "None policy: Start"
Jul 20 15:33:52.358243 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.358211    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 15:33:52.358243 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.358222    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 15:33:52.359525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.359514    2558 policy_none.go:47] "Start"
Jul 20 15:33:52.366194 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.366127    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-218.ec2.internal.18c409598065e451  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-218.ec2.internal,UID:ip-10-0-140-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-218.ec2.internal,},FirstTimestamp:2026-07-20 15:33:52.356459601 +0000 UTC m=+0.898187280,LastTimestamp:2026-07-20 15:33:52.356459601 +0000 UTC m=+0.898187280,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-218.ec2.internal,}"
Jul 20 15:33:52.377559 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.377500    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-218.ec2.internal.18c4095980665b29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-218.ec2.internal,UID:ip-10-0-140-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-218.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-218.ec2.internal,},FirstTimestamp:2026-07-20 15:33:52.356490025 +0000 UTC m=+0.898217700,LastTimestamp:2026-07-20 15:33:52.356490025 +0000 UTC m=+0.898217700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-218.ec2.internal,}"
Jul 20 15:33:52.388184 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.387695    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vgv4"
Jul 20 15:33:52.390026 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.389966    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-218.ec2.internal.18c4095980667e6d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-218.ec2.internal,UID:ip-10-0-140-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-218.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-218.ec2.internal,},FirstTimestamp:2026-07-20 15:33:52.356499053 +0000 UTC m=+0.898226727,LastTimestamp:2026-07-20 15:33:52.356499053 +0000 UTC m=+0.898226727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-218.ec2.internal,}"
Jul 20 15:33:52.395220 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.395203    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vgv4"
Jul 20 15:33:52.402339 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402324    2558 manager.go:337] "Starting Device Plugin manager"
Jul 20 15:33:52.402416 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.402354    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 15:33:52.402416 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402363    2558 server.go:87] "Starting device plugin registration server"
Jul 20 15:33:52.402605 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402594    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 15:33:52.402643 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402607    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 15:33:52.402721 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402704    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 15:33:52.402857 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402838    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 15:33:52.402964 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.402867    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 15:33:52.403376 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.403353    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 15:33:52.403451 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.403401    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.492890 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.492859    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 15:33:52.493923 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.492908    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 15:33:52.493923 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.492932    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 15:33:52.493923 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.492967    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 15:33:52.496079 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.496062    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:33:52.503694 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.503677    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.504495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.504478    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.504563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.504516    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.504563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.504530    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.504563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.504552    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.514973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.514959    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.515017 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.514980    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-218.ec2.internal\": node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.558025 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.557955    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.593288 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.593263    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"]
Jul 20 15:33:52.593385 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.593343    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.594311 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.594295    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.594378 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.594324    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.594378 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.594336    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.595441 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.595429    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.595567 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.595552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.595603 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.595586    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.596146 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596121    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.596237 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596162    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.596237 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596174    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.596237 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596179    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.596237 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596197    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.596237 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.596209    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.597267 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.597252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.597349 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.597275    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:33:52.597922 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.597897    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:33:52.597922 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.597921    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:33:52.598068 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.597934    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:33:52.611292 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.611274    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-218.ec2.internal\" not found" node="ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.615152 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.615138    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-218.ec2.internal\" not found" node="ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.640758 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.640723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.640841 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.640762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.640841 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.640784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b956d4ba6697a743c7af9ebd9f7e685e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-218.ec2.internal\" (UID: \"b956d4ba6697a743c7af9ebd9f7e685e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.658641 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.658612    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.741613 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.741613 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b956d4ba6697a743c7af9ebd9f7e685e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-218.ec2.internal\" (UID: \"b956d4ba6697a743c7af9ebd9f7e685e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.741839 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.741839 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.741839 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b956d4ba6697a743c7af9ebd9f7e685e-config\") pod \"kube-apiserver-proxy-ip-10-0-140-218.ec2.internal\" (UID: \"b956d4ba6697a743c7af9ebd9f7e685e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.741839 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.741702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5e44938340155bbeec53661fdbd7ff4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal\" (UID: \"c5e44938340155bbeec53661fdbd7ff4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.758694 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.758670    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.859710 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.859647    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:52.914835 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.914812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.916893 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:52.916876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:52.960628 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:52.960585    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:53.061175 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:53.061151    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:53.161674 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:53.161606    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:53.262118 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:53.262092    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-218.ec2.internal\" not found"
Jul 20 15:33:53.279253 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.279231    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 15:33:53.279393 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.279373    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 15:33:53.344686 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.344665    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:33:53.399098 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.399048    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 15:28:52 +0000 UTC" deadline="2027-12-15 03:50:41.886682763 +0000 UTC"
Jul 20 15:33:53.399098 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.399097    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12300h16m48.487590305s"
Jul 20 15:33:53.439407 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.439333    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:53.453813 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.453795    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 15:33:53.455576 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.455561    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal"
Jul 20 15:33:53.461002 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:53.460974    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e44938340155bbeec53661fdbd7ff4.slice/crio-4c8c439f4070c481c0b03eebd7d62b8daf28bb243ab3ed8853f3942893ee7333 WatchSource:0}: Error finding container 4c8c439f4070c481c0b03eebd7d62b8daf28bb243ab3ed8853f3942893ee7333: Status 404 returned error can't find the container with id 4c8c439f4070c481c0b03eebd7d62b8daf28bb243ab3ed8853f3942893ee7333
Jul 20 15:33:53.461395 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:53.461378    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb956d4ba6697a743c7af9ebd9f7e685e.slice/crio-3c65e9935ca527fcac0dd6b259808b458f2c21f343730e6e023c96c14b4f2b61 WatchSource:0}: Error finding container 3c65e9935ca527fcac0dd6b259808b458f2c21f343730e6e023c96c14b4f2b61: Status 404 returned error can't find the container with id 3c65e9935ca527fcac0dd6b259808b458f2c21f343730e6e023c96c14b4f2b61
Jul 20 15:33:53.465086 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.465068    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 15:33:53.466204 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.466191    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:33:53.496147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.496098    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal" event={"ID":"b956d4ba6697a743c7af9ebd9f7e685e","Type":"ContainerStarted","Data":"3c65e9935ca527fcac0dd6b259808b458f2c21f343730e6e023c96c14b4f2b61"}
Jul 20 15:33:53.496963 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.496946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal" event={"ID":"c5e44938340155bbeec53661fdbd7ff4","Type":"ContainerStarted","Data":"4c8c439f4070c481c0b03eebd7d62b8daf28bb243ab3ed8853f3942893ee7333"}
Jul 20 15:33:53.616730 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.616702    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:33:53.812364 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:53.812288    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:33:54.121047 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.120973    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:33:54.319082 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.319053    2558 apiserver.go:52] "Watching apiserver"
Jul 20 15:33:54.328015 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.327987    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 15:33:54.328428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.328407    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jsbw8","kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal","openshift-cluster-node-tuning-operator/tuned-49fj5","openshift-image-registry/node-ca-2n4ls","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal","openshift-multus/multus-additional-cni-plugins-fsvqs","openshift-multus/multus-hrw8g","kube-system/konnectivity-agent-gjv85","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm","openshift-dns/node-resolver-qxxsq","openshift-multus/network-metrics-daemon-hfwdl","openshift-network-diagnostics/network-check-target-c7bjv","openshift-network-operator/iptables-alerter-xddfj","openshift-ovn-kubernetes/ovnkube-node-x4wl4"]
Jul 20 15:33:54.329861 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.329834    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.331375 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.331348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.331479 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.331426    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:33:54.332594 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.332573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.333609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.333579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.333609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.333591    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gnnj5\""
Jul 20 15:33:54.333855 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.333835    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.335161 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.335138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.336588 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.336568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.337151 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.337134    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 15:33:54.337955 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.337838    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ftwq8\""
Jul 20 15:33:54.337955 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.337919    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 15:33:54.338086 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.337973    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 15:33:54.338194 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338174    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 15:33:54.338553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.338553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338339    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.338553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338290    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.338553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338291    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.338863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338726    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bc447\""
Jul 20 15:33:54.338863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338741    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 15:33:54.338863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338835    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.338863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338858    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.339054 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.338891    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v8f6g\""
Jul 20 15:33:54.339213 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339197    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.339355 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339340    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 15:33:54.339405 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339363    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 15:33:54.339456 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339422    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bc6s8\""
Jul 20 15:33:54.339511 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339467    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.339582 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339568    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 15:33:54.339645 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339579    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 15:33:54.339762 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339736    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 15:33:54.339854 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.339840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.340235 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.340217    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.340571 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.340552    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.340919 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.340899    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 15:33:54.341597 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.341575    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z6976\""
Jul 20 15:33:54.341679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.341645    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.342256 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.342239    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.342348 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.342292    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vsrg6\""
Jul 20 15:33:54.342407 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.342384    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.342607 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.342586    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 15:33:54.343367 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.343348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.343937 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.343904    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 15:33:54.344375 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.344358    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 15:33:54.344457 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.344357    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p5kpq\""
Jul 20 15:33:54.345212 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.345196    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.345301 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.345277    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:33:54.345383 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.345340    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vkjnb\""
Jul 20 15:33:54.345439 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.345375    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 15:33:54.345520 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.345502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 15:33:54.346898 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.346880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:54.346990 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.346928    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:33:54.351476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-hostroot\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.351476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.351623 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-host\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.351623 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-var-lib-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.351623 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-node-log\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.351623 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-log-socket\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-script-lib\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cni-binary-copy\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-socket-dir-parent\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-netns\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.351846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-run\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52g6\" (UniqueName: \"kubernetes.io/projected/c39d6958-3486-4a1c-9beb-9dabd5506459-kube-api-access-k52g6\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23f3f052-b32c-4827-8db6-50391261ae83-host\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-netns\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-env-overrides\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.351992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-daemon-config\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-etc-kubernetes\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352037    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-system-cni-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-cnibin\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-modprobe-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.352177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7937-0546-4cab-b488-28293a59042c-iptables-alerter-script\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7937-0546-4cab-b488-28293a59042c-host-slash\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnsk\" (UniqueName: \"kubernetes.io/projected/386c94ce-047f-419e-bc49-db7d3da7f6a6-kube-api-access-7cnsk\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23f3f052-b32c-4827-8db6-50391261ae83-serviceca\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-bin\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxf6q\" (UniqueName: \"kubernetes.io/projected/4928fab0-8438-4b8e-bed5-5042e04456a4-kube-api-access-pxf6q\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4928fab0-8438-4b8e-bed5-5042e04456a4-ovn-node-metrics-cert\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cnibin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-systemd\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-sys\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-system-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-os-release\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-k8s-cni-cncf-io\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-tuned\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wv5x\" (UniqueName: \"kubernetes.io/projected/791e7937-0546-4cab-b488-28293a59042c-kube-api-access-8wv5x\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.352688 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-systemd-units\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-etc-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-ovn\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-registration-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fbrh\" (UniqueName: \"kubernetes.io/projected/6aed60fd-677b-4e32-b932-34c26dd31ce5-kube-api-access-8fbrh\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-config\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-multus\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-multus-certs\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f875\" (UniqueName: \"kubernetes.io/projected/db58ebef-e2c5-454a-87d3-07b676ec7dd0-kube-api-access-6f875\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-kubernetes\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.352987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-sys-fs\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-tmp\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-os-release\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.353564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-systemd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-kubelet\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-conf-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353187    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb4fc\" (UniqueName: \"kubernetes.io/projected/23f3f052-b32c-4827-8db6-50391261ae83-kube-api-access-vb4fc\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-kubelet\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-netd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-device-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-bin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-lib-modules\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysconfig\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-conf\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-var-lib-kubelet\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8ww\" (UniqueName: \"kubernetes.io/projected/65796c67-79ca-47fb-b6cd-3dff4919b6dc-kube-api-access-4n8ww\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-slash\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.354247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.353542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-socket-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.387653 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.387631    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdcrg"
Jul 20 15:33:54.413116 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.413093    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdcrg"
Jul 20 15:33:54.440367 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.440348    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 15:33:54.453967 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.453943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.453975    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-systemd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-kubelet\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-conf-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb4fc\" (UniqueName: \"kubernetes.io/projected/23f3f052-b32c-4827-8db6-50391261ae83-kube-api-access-vb4fc\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-kubelet\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454087 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-netd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-kubelet\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-conf-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-systemd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-device-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454131    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-device-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-kubelet\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-bin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-netd\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-lib-modules\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysconfig\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-conf\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-var-lib-kubelet\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8ww\" (UniqueName: \"kubernetes.io/projected/65796c67-79ca-47fb-b6cd-3dff4919b6dc-kube-api-access-4n8ww\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-bin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-hosts-file\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-lib-modules\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.454428 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-slash\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-socket-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysconfig\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-hostroot\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-host\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-var-lib-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-var-lib-kubelet\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-node-log\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-log-socket\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-hostroot\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-script-lib\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-slash\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.454588    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.454689    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:54.954653249 +0000 UTC m=+3.496380931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-host\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.455344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454738    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-node-log\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-sysctl-conf\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-tmp-dir\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cni-binary-copy\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454551    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-socket-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-socket-dir-parent\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-log-socket\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-var-lib-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-netns\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-run\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52g6\" (UniqueName: \"kubernetes.io/projected/c39d6958-3486-4a1c-9beb-9dabd5506459-kube-api-access-k52g6\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-socket-dir-parent\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-kubelet-config\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23f3f052-b32c-4827-8db6-50391261ae83-host\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.456182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.454999    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-netns\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-netns\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-env-overrides\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-daemon-config\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455097    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-etc-kubernetes\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-system-cni-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-cnibin\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-modprobe-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-script-lib\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cni-binary-copy\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bb0be9b-b928-4483-b983-d661671e064a-agent-certs\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-run\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bb0be9b-b928-4483-b983-d661671e064a-konnectivity-ca\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.457013 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-netns\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-cnibin\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7937-0546-4cab-b488-28293a59042c-iptables-alerter-script\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-system-cni-dir\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23f3f052-b32c-4827-8db6-50391261ae83-host\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7937-0546-4cab-b488-28293a59042c-host-slash\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnsk\" (UniqueName: \"kubernetes.io/projected/386c94ce-047f-419e-bc49-db7d3da7f6a6-kube-api-access-7cnsk\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-modprobe-d\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-env-overrides\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23f3f052-b32c-4827-8db6-50391261ae83-serviceca\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-bin\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxf6q\" (UniqueName: \"kubernetes.io/projected/4928fab0-8438-4b8e-bed5-5042e04456a4-kube-api-access-pxf6q\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4928fab0-8438-4b8e-bed5-5042e04456a4-ovn-node-metrics-cert\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cnibin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.457741 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455831    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-systemd\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-sys\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-system-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-os-release\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-k8s-cni-cncf-io\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-tuned\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wv5x\" (UniqueName: \"kubernetes.io/projected/791e7937-0546-4cab-b488-28293a59042c-kube-api-access-8wv5x\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-systemd-units\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.455996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-daemon-config\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-etc-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-etc-kubernetes\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-ovn\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-k8s-cni-cncf-io\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791e7937-0546-4cab-b488-28293a59042c-iptables-alerter-script\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-registration-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.458550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-cnibin\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-registration-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-host-cni-bin\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-ovn\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-run-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456304    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fbrh\" (UniqueName: \"kubernetes.io/projected/6aed60fd-677b-4e32-b932-34c26dd31ce5-kube-api-access-8fbrh\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791e7937-0546-4cab-b488-28293a59042c-host-slash\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-config\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-multus-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-multus\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-systemd-units\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456433    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-multus-certs\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-os-release\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f875\" (UniqueName: \"kubernetes.io/projected/db58ebef-e2c5-454a-87d3-07b676ec7dd0-kube-api-access-6f875\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-system-cni-dir\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-kubernetes\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.459452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-dbus\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-sys\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-sys-fs\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4928fab0-8438-4b8e-bed5-5042e04456a4-etc-openvswitch\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23f3f052-b32c-4827-8db6-50391261ae83-serviceca\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-kubernetes\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-tmp\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-os-release\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqw62\" (UniqueName: \"kubernetes.io/projected/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-kube-api-access-fqw62\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39d6958-3486-4a1c-9beb-9dabd5506459-os-release\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aed60fd-677b-4e32-b932-34c26dd31ce5-sys-fs\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.456956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-var-lib-cni-multus\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.457019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-systemd\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.457056    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db58ebef-e2c5-454a-87d3-07b676ec7dd0-host-run-multus-certs\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.460148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.457228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c39d6958-3486-4a1c-9beb-9dabd5506459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.460679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.457466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4928fab0-8438-4b8e-bed5-5042e04456a4-ovnkube-config\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.460679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.459582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-etc-tuned\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.459715    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65796c67-79ca-47fb-b6cd-3dff4919b6dc-tmp\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.460679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.459851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4928fab0-8438-4b8e-bed5-5042e04456a4-ovn-node-metrics-cert\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.477558 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.477532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb4fc\" (UniqueName: \"kubernetes.io/projected/23f3f052-b32c-4827-8db6-50391261ae83-kube-api-access-vb4fc\") pod \"node-ca-2n4ls\" (UID: \"23f3f052-b32c-4827-8db6-50391261ae83\") " pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.480002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.479958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52g6\" (UniqueName: \"kubernetes.io/projected/c39d6958-3486-4a1c-9beb-9dabd5506459-kube-api-access-k52g6\") pod \"multus-additional-cni-plugins-fsvqs\" (UID: \"c39d6958-3486-4a1c-9beb-9dabd5506459\") " pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.484108 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.484084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8ww\" (UniqueName: \"kubernetes.io/projected/65796c67-79ca-47fb-b6cd-3dff4919b6dc-kube-api-access-4n8ww\") pod \"tuned-49fj5\" (UID: \"65796c67-79ca-47fb-b6cd-3dff4919b6dc\") " pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.493996 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.493974    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f875\" (UniqueName: \"kubernetes.io/projected/db58ebef-e2c5-454a-87d3-07b676ec7dd0-kube-api-access-6f875\") pod \"multus-hrw8g\" (UID: \"db58ebef-e2c5-454a-87d3-07b676ec7dd0\") " pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.494435 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.494409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxf6q\" (UniqueName: \"kubernetes.io/projected/4928fab0-8438-4b8e-bed5-5042e04456a4-kube-api-access-pxf6q\") pod \"ovnkube-node-x4wl4\" (UID: \"4928fab0-8438-4b8e-bed5-5042e04456a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.496913 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.496892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnsk\" (UniqueName: \"kubernetes.io/projected/386c94ce-047f-419e-bc49-db7d3da7f6a6-kube-api-access-7cnsk\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.497084 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.497069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fbrh\" (UniqueName: \"kubernetes.io/projected/6aed60fd-677b-4e32-b932-34c26dd31ce5-kube-api-access-8fbrh\") pod \"aws-ebs-csi-driver-node-rzfqm\" (UID: \"6aed60fd-677b-4e32-b932-34c26dd31ce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.497148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.497130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wv5x\" (UniqueName: \"kubernetes.io/projected/791e7937-0546-4cab-b488-28293a59042c-kube-api-access-8wv5x\") pod \"iptables-alerter-xddfj\" (UID: \"791e7937-0546-4cab-b488-28293a59042c\") " pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.557926 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.557890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bb0be9b-b928-4483-b983-d661671e064a-agent-certs\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.557926 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.557931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bb0be9b-b928-4483-b983-d661671e064a-konnectivity-ca\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.557958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.557999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-dbus\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqw62\" (UniqueName: \"kubernetes.io/projected/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-kube-api-access-fqw62\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-hosts-file\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-tmp-dir\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-dbus\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.558167 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-kubelet-config\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.558553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-kubelet-config\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:54.558553 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.558301    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:54.558553 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.558368    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:55.058349092 +0000 UTC m=+3.600076756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:54.558553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-hosts-file\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.558553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-tmp-dir\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.558826 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.558582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bb0be9b-b928-4483-b983-d661671e064a-konnectivity-ca\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.560557 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.560537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bb0be9b-b928-4483-b983-d661671e064a-agent-certs\") pod \"konnectivity-agent-gjv85\" (UID: \"4bb0be9b-b928-4483-b983-d661671e064a\") " pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.568309 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.568291    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:33:54.568415 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.568317    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:33:54.568415 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.568331    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:54.568415 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.568392    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:33:55.068379651 +0000 UTC m=+3.610107326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:54.570575 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.570549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqw62\" (UniqueName: \"kubernetes.io/projected/b1953acb-7e74-4ebd-a62c-fd91964d2f5c-kube-api-access-fqw62\") pod \"node-resolver-qxxsq\" (UID: \"b1953acb-7e74-4ebd-a62c-fd91964d2f5c\") " pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.642050 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.641977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrw8g"
Jul 20 15:33:54.649123 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.649102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-49fj5"
Jul 20 15:33:54.657894 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.657875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2n4ls"
Jul 20 15:33:54.670499 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.670478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:33:54.676310 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.676279    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fsvqs"
Jul 20 15:33:54.683738 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.683705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm"
Jul 20 15:33:54.690272 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.690248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xddfj"
Jul 20 15:33:54.695927 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.695902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:33:54.700624 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.700604    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxxsq"
Jul 20 15:33:54.961017 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:54.960937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:54.961182 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.961087    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:54.961182 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:54.961149    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:55.961132202 +0000 UTC m=+4.502859871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:55.061451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.061419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:55.061596 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.061573    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:55.061653 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.061641    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:56.061624934 +0000 UTC m=+4.603352609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:55.162419 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.162371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:55.162576 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.162552    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:33:55.162643 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.162582    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:33:55.162643 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.162597    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:55.162732 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.162660    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:33:56.16264203 +0000 UTC m=+4.704369692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:55.369761 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.369719    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aed60fd_677b_4e32_b932_34c26dd31ce5.slice/crio-ada6dab88edf88f18cbc8f7ef4232421e4a1a964b5542776e483f41c60a41617 WatchSource:0}: Error finding container ada6dab88edf88f18cbc8f7ef4232421e4a1a964b5542776e483f41c60a41617: Status 404 returned error can't find the container with id ada6dab88edf88f18cbc8f7ef4232421e4a1a964b5542776e483f41c60a41617
Jul 20 15:33:55.372212 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.372079    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4928fab0_8438_4b8e_bed5_5042e04456a4.slice/crio-649a45322998ee94b8abb31ac8fee2b6fe5f94c4bd0f3179bfac6b835533bafa WatchSource:0}: Error finding container 649a45322998ee94b8abb31ac8fee2b6fe5f94c4bd0f3179bfac6b835533bafa: Status 404 returned error can't find the container with id 649a45322998ee94b8abb31ac8fee2b6fe5f94c4bd0f3179bfac6b835533bafa
Jul 20 15:33:55.372988 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.372968    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39d6958_3486_4a1c_9beb_9dabd5506459.slice/crio-ffdd8e4c62c4f4bb1f772537235fd1fcbee9ffe38740d5e3adde0fe473842290 WatchSource:0}: Error finding container ffdd8e4c62c4f4bb1f772537235fd1fcbee9ffe38740d5e3adde0fe473842290: Status 404 returned error can't find the container with id ffdd8e4c62c4f4bb1f772537235fd1fcbee9ffe38740d5e3adde0fe473842290
Jul 20 15:33:55.378175 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.378149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791e7937_0546_4cab_b488_28293a59042c.slice/crio-9ee086d977f3d7ced082ec7ad74c6dd9b7c2e7ea9bee10761ec7210a3b73308c WatchSource:0}: Error finding container 9ee086d977f3d7ced082ec7ad74c6dd9b7c2e7ea9bee10761ec7210a3b73308c: Status 404 returned error can't find the container with id 9ee086d977f3d7ced082ec7ad74c6dd9b7c2e7ea9bee10761ec7210a3b73308c
Jul 20 15:33:55.379118 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.379094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1953acb_7e74_4ebd_a62c_fd91964d2f5c.slice/crio-2c666db81cfc94b0fa148fa01465424649e52913f1e24c3fb12517e066055e5c WatchSource:0}: Error finding container 2c666db81cfc94b0fa148fa01465424649e52913f1e24c3fb12517e066055e5c: Status 404 returned error can't find the container with id 2c666db81cfc94b0fa148fa01465424649e52913f1e24c3fb12517e066055e5c
Jul 20 15:33:55.380012 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.379991    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb0be9b_b928_4483_b983_d661671e064a.slice/crio-5587d2c3609970c9e931a2e5932b2ed1680e285cdf318ff000668d45dd072533 WatchSource:0}: Error finding container 5587d2c3609970c9e931a2e5932b2ed1680e285cdf318ff000668d45dd072533: Status 404 returned error can't find the container with id 5587d2c3609970c9e931a2e5932b2ed1680e285cdf318ff000668d45dd072533
Jul 20 15:33:55.380948 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.380923    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65796c67_79ca_47fb_b6cd_3dff4919b6dc.slice/crio-c864ab4a37518c8954861a3aa363ae5b7a0bd827ac06ebb61e553e38c26fc871 WatchSource:0}: Error finding container c864ab4a37518c8954861a3aa363ae5b7a0bd827ac06ebb61e553e38c26fc871: Status 404 returned error can't find the container with id c864ab4a37518c8954861a3aa363ae5b7a0bd827ac06ebb61e553e38c26fc871
Jul 20 15:33:55.382043 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.382022    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f3f052_b32c_4827_8db6_50391261ae83.slice/crio-9179e28a806adbdad367d9b550d1b1ec9c8e50ff34e1f00bcc19b42a675bcc97 WatchSource:0}: Error finding container 9179e28a806adbdad367d9b550d1b1ec9c8e50ff34e1f00bcc19b42a675bcc97: Status 404 returned error can't find the container with id 9179e28a806adbdad367d9b550d1b1ec9c8e50ff34e1f00bcc19b42a675bcc97
Jul 20 15:33:55.384033 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:33:55.383898    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb58ebef_e2c5_454a_87d3_07b676ec7dd0.slice/crio-9c49325176f565ccc39ec6ecd5f7960396ad71e0559e5862559e15506f05a32f WatchSource:0}: Error finding container 9c49325176f565ccc39ec6ecd5f7960396ad71e0559e5862559e15506f05a32f: Status 404 returned error can't find the container with id 9c49325176f565ccc39ec6ecd5f7960396ad71e0559e5862559e15506f05a32f
Jul 20 15:33:55.415147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.415123    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:28:54 +0000 UTC" deadline="2028-02-05 03:39:36.054476862 +0000 UTC"
Jul 20 15:33:55.415147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.415148    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13548h5m40.639333288s"
Jul 20 15:33:55.493400 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.493376    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:55.493500 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.493402    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:55.493500 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.493404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:55.493500 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.493473    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:33:55.493593 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.493555    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:33:55.493692 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.493667    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:33:55.503342 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.503319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal" event={"ID":"b956d4ba6697a743c7af9ebd9f7e685e","Type":"ContainerStarted","Data":"cc1f19c49ea03537e5b7e232f5bcc720ecc4c33ee13d01603681f5756df0ec8a"}
Jul 20 15:33:55.504874 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.504849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n4ls" event={"ID":"23f3f052-b32c-4827-8db6-50391261ae83","Type":"ContainerStarted","Data":"9179e28a806adbdad367d9b550d1b1ec9c8e50ff34e1f00bcc19b42a675bcc97"}
Jul 20 15:33:55.506322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.506299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xddfj" event={"ID":"791e7937-0546-4cab-b488-28293a59042c","Type":"ContainerStarted","Data":"9ee086d977f3d7ced082ec7ad74c6dd9b7c2e7ea9bee10761ec7210a3b73308c"}
Jul 20 15:33:55.507539 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.507517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerStarted","Data":"ffdd8e4c62c4f4bb1f772537235fd1fcbee9ffe38740d5e3adde0fe473842290"}
Jul 20 15:33:55.508487 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.508459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"649a45322998ee94b8abb31ac8fee2b6fe5f94c4bd0f3179bfac6b835533bafa"}
Jul 20 15:33:55.509582 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.509564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrw8g" event={"ID":"db58ebef-e2c5-454a-87d3-07b676ec7dd0","Type":"ContainerStarted","Data":"9c49325176f565ccc39ec6ecd5f7960396ad71e0559e5862559e15506f05a32f"}
Jul 20 15:33:55.510785 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.510743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjv85" event={"ID":"4bb0be9b-b928-4483-b983-d661671e064a","Type":"ContainerStarted","Data":"5587d2c3609970c9e931a2e5932b2ed1680e285cdf318ff000668d45dd072533"}
Jul 20 15:33:55.511736 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.511715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49fj5" event={"ID":"65796c67-79ca-47fb-b6cd-3dff4919b6dc","Type":"ContainerStarted","Data":"c864ab4a37518c8954861a3aa363ae5b7a0bd827ac06ebb61e553e38c26fc871"}
Jul 20 15:33:55.512636 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.512616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxxsq" event={"ID":"b1953acb-7e74-4ebd-a62c-fd91964d2f5c","Type":"ContainerStarted","Data":"2c666db81cfc94b0fa148fa01465424649e52913f1e24c3fb12517e066055e5c"}
Jul 20 15:33:55.513684 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.513665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm" event={"ID":"6aed60fd-677b-4e32-b932-34c26dd31ce5","Type":"ContainerStarted","Data":"ada6dab88edf88f18cbc8f7ef4232421e4a1a964b5542776e483f41c60a41617"}
Jul 20 15:33:55.518555 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.518510    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-218.ec2.internal" podStartSLOduration=2.518486868 podStartE2EDuration="2.518486868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:33:55.51801976 +0000 UTC m=+4.059747445" watchObservedRunningTime="2026-07-20 15:33:55.518486868 +0000 UTC m=+4.060214554"
Jul 20 15:33:55.970283 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:55.969880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:55.970283 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.970126    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:55.970283 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:55.970208    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:57.970184614 +0000 UTC m=+6.511912289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:56.071491 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.071457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:56.071675 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.071634    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:56.071740 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.071694    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:33:58.071675871 +0000 UTC m=+6.613403548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:56.173418 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.172785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:56.173418 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.172980    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:33:56.173418 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.172999    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:33:56.173418 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.173011    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:56.173418 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:56.173065    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:33:58.173048008 +0000 UTC m=+6.714775682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:56.415457 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.415333    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:28:54 +0000 UTC" deadline="2028-01-27 21:54:08.795667561 +0000 UTC"
Jul 20 15:33:56.415457 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.415384    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13350h20m12.380287025s"
Jul 20 15:33:56.521588 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.520479    2558 generic.go:356] "Generic (PLEG): container finished" podID="c5e44938340155bbeec53661fdbd7ff4" containerID="c2208270bbc4b3daf8a35422a51f88021dd94612f8fa3c2988f5e11cecbf40a7" exitCode=0
Jul 20 15:33:56.521588 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:56.521385    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal" event={"ID":"c5e44938340155bbeec53661fdbd7ff4","Type":"ContainerDied","Data":"c2208270bbc4b3daf8a35422a51f88021dd94612f8fa3c2988f5e11cecbf40a7"}
Jul 20 15:33:57.494154 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:57.494123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:57.494616 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:57.494269    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:33:57.494683 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:57.494626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:57.494737 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:57.494719    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:33:57.494818 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:57.494788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:57.494875 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:57.494852    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:33:57.540364 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:57.540329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal" event={"ID":"c5e44938340155bbeec53661fdbd7ff4","Type":"ContainerStarted","Data":"e4f060321d915fe457a8434b59c1c1fca6ad09e361f2ce4454f46154a9ebb0c1"}
Jul 20 15:33:57.989663 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:57.989006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:57.989663 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:57.989192    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:57.989663 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:57.989258    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:01.989239891 +0000 UTC m=+10.530967557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:33:58.089790 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:58.089741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:58.089967 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.089917    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:58.090030 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.089980    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:02.089962864 +0000 UTC m=+10.631690543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:33:58.190920 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:58.190865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:58.191102 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.191085    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:33:58.191166 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.191107    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:33:58.191166 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.191120    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:58.191269 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:58.191175    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:34:02.191157067 +0000 UTC m=+10.732884746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:33:59.493982 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:59.493947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:33:59.494413 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:59.494097    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:33:59.494492 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:59.494472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:33:59.494596 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:59.494576    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:33:59.494655 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:33:59.494626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:33:59.494703 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:33:59.494693    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:01.493592 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:01.493552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:01.494065 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:01.493560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:01.494065 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:01.493692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:01.494065 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:01.493701    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:01.494065 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:01.493798    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:01.494065 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:01.493884    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:02.021103 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:02.021069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:02.021293 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.021244    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:02.021352 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.021316    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:10.021295049 +0000 UTC m=+18.563022716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:02.121525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:02.121488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:02.121703 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.121650    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:02.121779 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.121707    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:10.121688463 +0000 UTC m=+18.663416140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:02.222299 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:02.222262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:02.222486 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.222444    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:34:02.222486 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.222466    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:34:02.222486 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.222478    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:02.222642 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:02.222544    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:34:10.222524152 +0000 UTC m=+18.764251859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:03.493316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:03.493279    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:03.493316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:03.493308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:03.493316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:03.493279    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:03.493914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:03.493411    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:03.493914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:03.493496    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:03.493914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:03.493555    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:05.494277 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:05.494236    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:05.494716 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:05.494368    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:05.494716 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:05.494237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:05.494716 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:05.494470    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:05.494716 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:05.494248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:05.494716 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:05.494556    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:07.493643 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:07.493614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:07.493643 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:07.493640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:07.494136 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:07.493705    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:07.494136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:07.493727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:07.494136 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:07.493829    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:07.494136 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:07.493910    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:09.493453 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:09.493416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:09.493453 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:09.493447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:09.493941 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:09.493508    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:09.493941 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:09.493522    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:09.493941 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:09.493614    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:09.493941 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:09.493709    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:10.079985 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:10.079947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:10.080597 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.080492    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:10.080724 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.080604    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:26.080576666 +0000 UTC m=+34.622304330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:10.181273 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:10.181234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:10.181470 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.181427    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:10.181537 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.181512    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:26.181490361 +0000 UTC m=+34.723218034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:10.281955 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:10.281917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:10.282146 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.282123    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:34:10.282192 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.282154    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:34:10.282192 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.282170    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:10.282289 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:10.282244    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:34:26.282222678 +0000 UTC m=+34.823950365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:11.493687 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:11.493623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:11.493687 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:11.493655    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:11.493687 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:11.493665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:11.494263 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:11.493782    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:11.494263 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:11.493843    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:11.494263 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:11.493913    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:13.493711 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:13.493681    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:13.494191 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:13.493821    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:13.494191 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:13.493827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:13.494191 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:13.493856    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:13.494191 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:13.493916    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:13.494191 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:13.493987    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:14.578384 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.577940    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-49fj5" event={"ID":"65796c67-79ca-47fb-b6cd-3dff4919b6dc","Type":"ContainerStarted","Data":"2706ea2da28a2c2eee2bebc4a8f08a7625f045103e66f3c4fa9ad58d2c53d2f5"}
Jul 20 15:34:14.579363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.579337    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxxsq" event={"ID":"b1953acb-7e74-4ebd-a62c-fd91964d2f5c","Type":"ContainerStarted","Data":"25f66e7f7ccd25390294213102bc014133d37385655dcb5e79dcd6d74acabf09"}
Jul 20 15:34:14.580992 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.580967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm" event={"ID":"6aed60fd-677b-4e32-b932-34c26dd31ce5","Type":"ContainerStarted","Data":"1415cf322584c836afc4cf7e9db2ca9060cc03a544a2589388e964c42c0c2047"}
Jul 20 15:34:14.582495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.582463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2n4ls" event={"ID":"23f3f052-b32c-4827-8db6-50391261ae83","Type":"ContainerStarted","Data":"0a44513b6a552f807436ed43aed043275194fd55007e63a69785891f22e4ac5e"}
Jul 20 15:34:14.583959 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.583936    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="59b5afe25953eb8379b85fe18b31c834b68cd046bbc0a69f582423d22650453d" exitCode=0
Jul 20 15:34:14.584068 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.584014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"59b5afe25953eb8379b85fe18b31c834b68cd046bbc0a69f582423d22650453d"}
Jul 20 15:34:14.587451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"71c9100411a8cadfed6c34f02f223e12924e17adc9d5a0ab4a2a7b605febfe8a"}
Jul 20 15:34:14.587555 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"84eb6635364c719050f816c8f31e4fccb548ccf4441f44396be59cbbde83ad30"}
Jul 20 15:34:14.587555 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"1819cb76fab806310aa02d184c522d3b91ac0d652c7f7b77f072eebfa6e83cc5"}
Jul 20 15:34:14.587672 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"baec2b65783a114dca9180de8e3f7e189ea9765da7bc2810d227ca2697ccbd8c"}
Jul 20 15:34:14.587672 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"f7c9f90023a5168d600773f8a9b6480fdd8fce9e26a2e6e780c94c3189ee56d8"}
Jul 20 15:34:14.587672 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.587645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"4baa4c979570c5d43a7565bca710e0b9a7197d85c4aabf8961a56ab06c0592a1"}
Jul 20 15:34:14.588854 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.588833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrw8g" event={"ID":"db58ebef-e2c5-454a-87d3-07b676ec7dd0","Type":"ContainerStarted","Data":"edb95618e171f8e1be9bd745bd2cd7ecb4d0a117adba90ac24f9b8f6fdbf5982"}
Jul 20 15:34:14.590330 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.590311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjv85" event={"ID":"4bb0be9b-b928-4483-b983-d661671e064a","Type":"ContainerStarted","Data":"768256dc44d9aedc42550a041a9aba8e1b425336eec3bde40999bbd9c22938ed"}
Jul 20 15:34:14.593844 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.593792    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-49fj5" podStartSLOduration=4.257574208 podStartE2EDuration="22.59377702s" totalImagesPullingTime="18.336202812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:14.593628248 +0000 UTC m=+23.135355932" watchObservedRunningTime="2026-07-20 15:34:14.59377702 +0000 UTC m=+23.135504702"
Jul 20 15:34:14.594045 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.594020    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-218.ec2.internal" podStartSLOduration=21.594008899 podStartE2EDuration="21.594008899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:33:57.563915451 +0000 UTC m=+6.105643138" watchObservedRunningTime="2026-07-20 15:34:14.594008899 +0000 UTC m=+23.135736585"
Jul 20 15:34:14.611281 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.611245    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qxxsq" podStartSLOduration=4.303446582 podStartE2EDuration="22.611231329s" totalImagesPullingTime="18.307784747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:14.611190254 +0000 UTC m=+23.152917937" watchObservedRunningTime="2026-07-20 15:34:14.611231329 +0000 UTC m=+23.152959012"
Jul 20 15:34:14.639070 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.639025    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hrw8g" podStartSLOduration=4.282219878 podStartE2EDuration="22.639013085s" totalImagesPullingTime="18.356793207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:14.638534473 +0000 UTC m=+23.180262156" watchObservedRunningTime="2026-07-20 15:34:14.639013085 +0000 UTC m=+23.180740770"
Jul 20 15:34:14.657722 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.657684    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2n4ls" podStartSLOduration=4.353063312 podStartE2EDuration="22.657670437s" totalImagesPullingTime="18.304607125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:14.657415022 +0000 UTC m=+23.199142706" watchObservedRunningTime="2026-07-20 15:34:14.657670437 +0000 UTC m=+23.199398121"
Jul 20 15:34:14.822194 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.822166    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:34:14.822789 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.822774    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:34:14.838808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:14.838716    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjv85" podStartSLOduration=8.970566258 podStartE2EDuration="22.83870221s" totalImagesPullingTime="13.868135952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:14.699051354 +0000 UTC m=+23.240779037" watchObservedRunningTime="2026-07-20 15:34:14.83870221 +0000 UTC m=+23.380429885"
Jul 20 15:34:15.493180 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.493149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:15.493472 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.493192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:15.493472 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.493250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:15.493472 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:15.493265    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:15.493472 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:15.493365    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:15.493472 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:15.493450    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:15.595501 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.595043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xddfj" event={"ID":"791e7937-0546-4cab-b488-28293a59042c","Type":"ContainerStarted","Data":"8222aea25006087895f1d12845221285751afeee36908f27fc15ec8d89789d6d"}
Jul 20 15:34:15.596120 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.595533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:34:15.596120 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.595734    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjv85"
Jul 20 15:34:15.622499 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.622454    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xddfj" podStartSLOduration=5.313557592 podStartE2EDuration="23.62243726s" totalImagesPullingTime="18.308879668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:15.609740031 +0000 UTC m=+24.151467715" watchObservedRunningTime="2026-07-20 15:34:15.62243726 +0000 UTC m=+24.164164943"
Jul 20 15:34:15.677637 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:15.677599    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 15:34:16.414942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:16.414836    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T15:34:15.677628006Z","UUID":"7aecaf6a-6505-4240-a51d-0b64c11ae330","Handler":null,"Name":"","Endpoint":""}
Jul 20 15:34:16.416278 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:16.416261    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 15:34:16.416372 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:16.416296    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 15:34:16.615454 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:16.615425    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm" event={"ID":"6aed60fd-677b-4e32-b932-34c26dd31ce5","Type":"ContainerStarted","Data":"b1f9357651273920e3cc1c4497825e46bd5be68a11c80af27b5fa4937c00b793"}
Jul 20 15:34:17.493242 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.493217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:17.493371 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.493248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:17.493371 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.493218    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:17.493371 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:17.493320    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:17.493534 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:17.493425    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:17.493534 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:17.493479    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:17.620899 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.620697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"bde9b7d9b921fc17da453c44385516896ae6b58489d90ff57209a66dbb6fa413"}
Jul 20 15:34:17.622617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.622589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm" event={"ID":"6aed60fd-677b-4e32-b932-34c26dd31ce5","Type":"ContainerStarted","Data":"aecd27fc2c3ce39bd172476cd24a1bf5facb449f38a99e4f32126fb3c98e8081"}
Jul 20 15:34:17.640702 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:17.640651    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzfqm" podStartSLOduration=8.362145276 podStartE2EDuration="25.64063353s" totalImagesPullingTime="17.278488254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:17.640191128 +0000 UTC m=+26.181918814" watchObservedRunningTime="2026-07-20 15:34:17.64063353 +0000 UTC m=+26.182361216"
Jul 20 15:34:19.493270 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.493237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:19.493270 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.493281    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:19.494111 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.493335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:19.494111 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:19.493348    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:19.494111 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:19.493446    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:19.494111 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:19.493519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:19.631438 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.631278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" event={"ID":"4928fab0-8438-4b8e-bed5-5042e04456a4","Type":"ContainerStarted","Data":"4f43325e45ab4475362ab57f68583805a47262966cabc958e41c954e190feff2"}
Jul 20 15:34:19.631640 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.631621    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:19.631709 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.631696    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:19.656448 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.656418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:19.717830 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:19.717779    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4" podStartSLOduration=9.301596788 podStartE2EDuration="27.717763779s" totalImagesPullingTime="18.416166991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:19.717558073 +0000 UTC m=+28.259285776" watchObservedRunningTime="2026-07-20 15:34:19.717763779 +0000 UTC m=+28.259491459"
Jul 20 15:34:20.633866 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:20.633836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:20.648439 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:20.648411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:21.030557 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.030525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsbw8"]
Jul 20 15:34:21.030700 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.030655    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:21.030806 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:21.030784    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:21.032483 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.032461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7bjv"]
Jul 20 15:34:21.032587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.032558    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:21.032670 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:21.032647    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:21.035055 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.035035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfwdl"]
Jul 20 15:34:21.035139 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.035128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:21.035278 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:21.035257    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:21.636845 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.636814    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="a0ae96d98f33bb761141c130ef5df4da47ff43bbff23ec29f9be496f455bc395" exitCode=0
Jul 20 15:34:21.637228 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:21.636892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"a0ae96d98f33bb761141c130ef5df4da47ff43bbff23ec29f9be496f455bc395"}
Jul 20 15:34:22.494602 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:22.494567    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:22.494787 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:22.494698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:22.494787 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:22.494722    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:22.494787 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:22.494766    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:22.494939 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:22.494809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:22.494939 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:22.494904    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:23.643079 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:23.643050    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="801273af7ef363a03aa53ff09a6d24970943a940b4b421a19c0c8f274a9a26fb" exitCode=0
Jul 20 15:34:23.643451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:23.643095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"801273af7ef363a03aa53ff09a6d24970943a940b4b421a19c0c8f274a9a26fb"}
Jul 20 15:34:24.493387 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:24.493350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:24.493553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:24.493351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:24.493553 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:24.493358    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:24.493553 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:24.493500    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c7bjv" podUID="249627f3-9568-4b3c-82e0-329fb36344ad"
Jul 20 15:34:24.493731 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:24.493602    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:34:24.493731 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:24.493676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsbw8" podUID="ec2f9fae-500a-4e8e-ab2e-f32d040a2565"
Jul 20 15:34:25.649938 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:25.649901    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="e78ee06541b9b1d7627c65a3b7442251aef4d68aa89ea416130c9bc5a49358c2" exitCode=0
Jul 20 15:34:25.650337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:25.649960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"e78ee06541b9b1d7627c65a3b7442251aef4d68aa89ea416130c9bc5a49358c2"}
Jul 20 15:34:26.100022 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.099947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:26.100147 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.100060    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:26.100147 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.100108    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:58.100093678 +0000 UTC m=+66.641821340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:34:26.192532 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.192511    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-218.ec2.internal" event="NodeReady"
Jul 20 15:34:26.192655 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.192644    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 15:34:26.200670 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.200651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:26.200800 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.200787    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:26.200844 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.200835    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret podName:ec2f9fae-500a-4e8e-ab2e-f32d040a2565 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:58.200822366 +0000 UTC m=+66.742550027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret") pod "global-pull-secret-syncer-jsbw8" (UID: "ec2f9fae-500a-4e8e-ab2e-f32d040a2565") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:34:26.240313 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.240267    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:34:26.251098 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.251076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.255180 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.255162    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 15:34:26.255380 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.255367    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptfkc\""
Jul 20 15:34:26.255693 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.255678    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 15:34:26.256763 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.256705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 15:34:26.258894 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.258872    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9dhxp"]
Jul 20 15:34:26.266307 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.266286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 15:34:26.272902 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.272882    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:34:26.272999 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.272912    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hzx4m"]
Jul 20 15:34:26.273046 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.273028    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.274689 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.274670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 15:34:26.274811 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.274733    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7h8p6\""
Jul 20 15:34:26.275366 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.275350    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 15:34:26.282257 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.282198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9dhxp"]
Jul 20 15:34:26.282257 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.282240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzx4m"]
Jul 20 15:34:26.282407 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.282324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.284483 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.284463    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 15:34:26.284791 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.284775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h6qpz\""
Jul 20 15:34:26.284890 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.284798    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 15:34:26.285206 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.285192    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 15:34:26.301525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.301499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:26.301650 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.301635    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:34:26.301722 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.301657    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:34:26.301722 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.301669    2558 projected.go:196] Error preparing data for projected volume kube-api-access-jtthj for pod openshift-network-diagnostics/network-check-target-c7bjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:26.301840 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.301732    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj podName:249627f3-9568-4b3c-82e0-329fb36344ad nodeName:}" failed. No retries permitted until 2026-07-20 15:34:58.301713214 +0000 UTC m=+66.843440881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jtthj" (UniqueName: "kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj") pod "network-check-target-c7bjv" (UID: "249627f3-9568-4b3c-82e0-329fb36344ad") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:34:26.402545 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402669 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402552    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bccab366-ff18-488f-982e-1ba9be77e312-tmp-dir\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.402669 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402669 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8be52aba-60eb-46d6-935a-cc9be9ff19f9-cert\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.402791 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.402791 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lphkl\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402791 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402883 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402883 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bccab366-ff18-488f-982e-1ba9be77e312-config-volume\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.402883 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2psl\" (UniqueName: \"kubernetes.io/projected/8be52aba-60eb-46d6-935a-cc9be9ff19f9-kube-api-access-v2psl\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.402962 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402994 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.402994 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.403052 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.402999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5vf\" (UniqueName: \"kubernetes.io/projected/bccab366-ff18-488f-982e-1ba9be77e312-kube-api-access-xc5vf\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.493321 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.493290    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:26.493467 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.493299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:26.493467 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.493299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:26.495448 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495425    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 15:34:26.495587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495457    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 15:34:26.495587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495459    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 15:34:26.495587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495508    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbh6k\""
Jul 20 15:34:26.495587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495555    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc62l\""
Jul 20 15:34:26.495795 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.495729    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 15:34:26.504267 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504339 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504339 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504339 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5vf\" (UniqueName: \"kubernetes.io/projected/bccab366-ff18-488f-982e-1ba9be77e312-kube-api-access-xc5vf\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bccab366-ff18-488f-982e-1ba9be77e312-tmp-dir\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8be52aba-60eb-46d6-935a-cc9be9ff19f9-cert\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.504549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lphkl\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.504876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bccab366-ff18-488f-982e-1ba9be77e312-config-volume\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.504876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2psl\" (UniqueName: \"kubernetes.io/projected/8be52aba-60eb-46d6-935a-cc9be9ff19f9-kube-api-access-v2psl\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.504876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.504767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bccab366-ff18-488f-982e-1ba9be77e312-tmp-dir\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.505139 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.505079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.505139 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.505118    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:26.505234 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.505148    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:26.505234 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.505163    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:26.505234 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.505179    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:27.005161129 +0000 UTC m=+35.546888790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:26.505234 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:26.505208    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:27.005191855 +0000 UTC m=+35.546919532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:26.505445 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.505405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.505499 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.505466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.505559 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.505546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bccab366-ff18-488f-982e-1ba9be77e312-config-volume\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.508808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.508789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8be52aba-60eb-46d6-935a-cc9be9ff19f9-cert\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.508875 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.508846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.509223 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.509203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.513146 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.513106    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5vf\" (UniqueName: \"kubernetes.io/projected/bccab366-ff18-488f-982e-1ba9be77e312-kube-api-access-xc5vf\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:26.513430 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.513411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2psl\" (UniqueName: \"kubernetes.io/projected/8be52aba-60eb-46d6-935a-cc9be9ff19f9-kube-api-access-v2psl\") pod \"ingress-canary-hzx4m\" (UID: \"8be52aba-60eb-46d6-935a-cc9be9ff19f9\") " pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.513485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.513452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lphkl\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.514040 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.514021    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:26.590282 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.590246    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzx4m"
Jul 20 15:34:26.733423 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:26.733393    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzx4m"]
Jul 20 15:34:26.737961 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:34:26.737929    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be52aba_60eb_46d6_935a_cc9be9ff19f9.slice/crio-5c15cf3e77b4614fa984444936ac13c367b89df743c739619a5a59d06acfc8aa WatchSource:0}: Error finding container 5c15cf3e77b4614fa984444936ac13c367b89df743c739619a5a59d06acfc8aa: Status 404 returned error can't find the container with id 5c15cf3e77b4614fa984444936ac13c367b89df743c739619a5a59d06acfc8aa
Jul 20 15:34:27.010781 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:27.010479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:27.010781 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:27.010674    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:27.011057 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:27.010794    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:27.011057 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:27.010763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:27.011057 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:27.010863    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:27.011057 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:27.010875    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:28.010852802 +0000 UTC m=+36.552580469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:27.011057 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:27.010925    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:28.010910347 +0000 UTC m=+36.552638014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:27.658893 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:27.658856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzx4m" event={"ID":"8be52aba-60eb-46d6-935a-cc9be9ff19f9","Type":"ContainerStarted","Data":"5c15cf3e77b4614fa984444936ac13c367b89df743c739619a5a59d06acfc8aa"}
Jul 20 15:34:28.019474 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:28.019387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:28.019474 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:28.019444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:28.019947 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:28.019568    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:28.019947 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:28.019598    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:28.019947 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:28.019579    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:28.019947 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:28.019663    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:30.019648942 +0000 UTC m=+38.561376605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:28.019947 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:28.019683    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:30.019674136 +0000 UTC m=+38.561401816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:30.036072 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:30.036032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:30.036102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:30.036209    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:30.036223    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:30.036233    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:30.036287    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:34.03627297 +0000 UTC m=+42.578000637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:30.036512 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:30.036300    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:34.036294542 +0000 UTC m=+42.578022204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:32.671394 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:32.671355    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="d2dcce809af0a7f41efd3c77d44099cd22f5c5d82200f0525c68ad398728bfa3" exitCode=0
Jul 20 15:34:32.671868 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:32.671448    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"d2dcce809af0a7f41efd3c77d44099cd22f5c5d82200f0525c68ad398728bfa3"}
Jul 20 15:34:32.672799 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:32.672762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzx4m" event={"ID":"8be52aba-60eb-46d6-935a-cc9be9ff19f9","Type":"ContainerStarted","Data":"c19caeb821ef8b7437ddc4685a7dc7fd520eef4b4de5cb50df2aedef79c28a20"}
Jul 20 15:34:32.710050 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:32.710009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hzx4m" podStartSLOduration=1.781987043 podStartE2EDuration="6.709996414s" totalImagesPullingTime="4.928009371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:32.709472244 +0000 UTC m=+41.251199940" watchObservedRunningTime="2026-07-20 15:34:32.709996414 +0000 UTC m=+41.251724098"
Jul 20 15:34:33.678235 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:33.678197    2558 generic.go:356] "Generic (PLEG): container finished" podID="c39d6958-3486-4a1c-9beb-9dabd5506459" containerID="6c0a45083ba3550cc6fdadfb6261ead1560ae738916177f125a29bd655fe461a" exitCode=0
Jul 20 15:34:33.678617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:33.678279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerDied","Data":"6c0a45083ba3550cc6fdadfb6261ead1560ae738916177f125a29bd655fe461a"}
Jul 20 15:34:34.070452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:34.070369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:34.070452 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:34.070427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:34.070629 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:34.070522    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:34.070629 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:34.070540    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:34.070629 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:34.070585    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:42.070571716 +0000 UTC m=+50.612299381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:34.070629 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:34.070522    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:34.070779 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:34.070660    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:42.070643815 +0000 UTC m=+50.612371477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:34.683778 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:34.683726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" event={"ID":"c39d6958-3486-4a1c-9beb-9dabd5506459","Type":"ContainerStarted","Data":"dc7ffafbb1c73f2a7e8920d66979d344115c26e5b5168d0047aeb0bf828a977a"}
Jul 20 15:34:34.720288 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:34.720233    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fsvqs" podStartSLOduration=9.228780681 podStartE2EDuration="42.720215197s" totalImagesPullingTime="33.491434516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:34:34.720168384 +0000 UTC m=+43.261896070" watchObservedRunningTime="2026-07-20 15:34:34.720215197 +0000 UTC m=+43.261942913"
Jul 20 15:34:42.121073 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:42.121026    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:42.121131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:42.121185    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:42.121249    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:42.121267    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:42.121257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:34:58.121241589 +0000 UTC m=+66.662969251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:42.121533 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:42.121335    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:34:58.121318452 +0000 UTC m=+66.663046120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:52.654177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:52.654149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4wl4"
Jul 20 15:34:58.139804 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.139767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:34:58.139804 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.139808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.139829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.139924    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.139939    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.139962    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.140005    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:35:30.139989693 +0000 UTC m=+98.681717356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:34:58.140216 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.140020    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:35:30.140013085 +0000 UTC m=+98.681740747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:34:58.143109 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.143090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 15:34:58.149982 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.149962    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 15:34:58.150038 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:34:58.150026    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:36:02.150010164 +0000 UTC m=+130.691737825 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : secret "metrics-daemon-secret" not found
Jul 20 15:34:58.240278 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.240248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:58.242461 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.242444    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 15:34:58.254353 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.254324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec2f9fae-500a-4e8e-ab2e-f32d040a2565-original-pull-secret\") pod \"global-pull-secret-syncer-jsbw8\" (UID: \"ec2f9fae-500a-4e8e-ab2e-f32d040a2565\") " pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:58.309651 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.309613    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsbw8"
Jul 20 15:34:58.341062 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.341028    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:58.343218 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.343200    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 15:34:58.353528 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.353501    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 15:34:58.364564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.364539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtthj\" (UniqueName: \"kubernetes.io/projected/249627f3-9568-4b3c-82e0-329fb36344ad-kube-api-access-jtthj\") pod \"network-check-target-c7bjv\" (UID: \"249627f3-9568-4b3c-82e0-329fb36344ad\") " pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:58.429366 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.429277    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsbw8"]
Jul 20 15:34:58.433683 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:34:58.433656    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec2f9fae_500a_4e8e_ab2e_f32d040a2565.slice/crio-3b8d98e6f0bb07f7b5f716291b3c78e8521cf5281ba575e32e6f75e48541fe06 WatchSource:0}: Error finding container 3b8d98e6f0bb07f7b5f716291b3c78e8521cf5281ba575e32e6f75e48541fe06: Status 404 returned error can't find the container with id 3b8d98e6f0bb07f7b5f716291b3c78e8521cf5281ba575e32e6f75e48541fe06
Jul 20 15:34:58.604997 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.604964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc62l\""
Jul 20 15:34:58.613614 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.613581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:34:58.729773 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.729724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c7bjv"]
Jul 20 15:34:58.732884 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:34:58.732858    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249627f3_9568_4b3c_82e0_329fb36344ad.slice/crio-7ea7c8f57f30a37500513ac7aa00326b2e2ad790d9f670527c8c910329499bcf WatchSource:0}: Error finding container 7ea7c8f57f30a37500513ac7aa00326b2e2ad790d9f670527c8c910329499bcf: Status 404 returned error can't find the container with id 7ea7c8f57f30a37500513ac7aa00326b2e2ad790d9f670527c8c910329499bcf
Jul 20 15:34:58.741829 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.741800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsbw8" event={"ID":"ec2f9fae-500a-4e8e-ab2e-f32d040a2565","Type":"ContainerStarted","Data":"3b8d98e6f0bb07f7b5f716291b3c78e8521cf5281ba575e32e6f75e48541fe06"}
Jul 20 15:34:58.742820 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:34:58.742798    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7bjv" event={"ID":"249627f3-9568-4b3c-82e0-329fb36344ad","Type":"ContainerStarted","Data":"7ea7c8f57f30a37500513ac7aa00326b2e2ad790d9f670527c8c910329499bcf"}
Jul 20 15:35:03.761477 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:03.761445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c7bjv" event={"ID":"249627f3-9568-4b3c-82e0-329fb36344ad","Type":"ContainerStarted","Data":"e79d3a779010b15ff5440d7dd4ad73c6a4e4ed658e5f2b8853988ac84d2f73ff"}
Jul 20 15:35:03.761976 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:03.761532    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:35:03.762951 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:03.762920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsbw8" event={"ID":"ec2f9fae-500a-4e8e-ab2e-f32d040a2565","Type":"ContainerStarted","Data":"f217323da8eeba043cc26dfc1e41a65ea81d78484eeabb5ddee124f2ee27bddb"}
Jul 20 15:35:03.778178 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:03.778129    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c7bjv" podStartSLOduration=66.874733713 podStartE2EDuration="1m11.778110569s" totalImagesPullingTime="4.903376856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:35:03.778019291 +0000 UTC m=+72.319746978" watchObservedRunningTime="2026-07-20 15:35:03.778110569 +0000 UTC m=+72.319838255"
Jul 20 15:35:03.793016 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:03.792952    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jsbw8" podStartSLOduration=66.586922605 podStartE2EDuration="1m11.792927666s" totalImagesPullingTime="5.206005061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:35:03.791897605 +0000 UTC m=+72.333625289" watchObservedRunningTime="2026-07-20 15:35:03.792927666 +0000 UTC m=+72.334655350"
Jul 20 15:35:23.785569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.785457    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"]
Jul 20 15:35:23.787877 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.787860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:23.790380 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.790359    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 15:35:23.790508 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.790416    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 15:35:23.790508 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.790359    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 15:35:23.790508 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.790361    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 15:35:23.797182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.797158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"]
Jul 20 15:35:23.928122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.928091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4pg\" (UniqueName: \"kubernetes.io/projected/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-kube-api-access-4d4pg\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:23.928236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.928144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-tmp\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:23.928236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:23.928218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.028963 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.028935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-tmp\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.029058 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.028983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.029058 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.029019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4pg\" (UniqueName: \"kubernetes.io/projected/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-kube-api-access-4d4pg\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.029340 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.029319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-tmp\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.031450 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.031433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.036684 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.036630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4pg\" (UniqueName: \"kubernetes.io/projected/9acd2dea-c08f-4e74-8232-a4e5dcf0144d-kube-api-access-4d4pg\") pod \"klusterlet-addon-workmgr-7b794f9fb4-kw78v\" (UID: \"9acd2dea-c08f-4e74-8232-a4e5dcf0144d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.096429 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.096392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:24.212640 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.212612    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"]
Jul 20 15:35:24.216144 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:35:24.216119    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9acd2dea_c08f_4e74_8232_a4e5dcf0144d.slice/crio-472deb10a9a5bc99e2329533b1032f0ec1a4e55e492ee2caafd399ad19df0e7a WatchSource:0}: Error finding container 472deb10a9a5bc99e2329533b1032f0ec1a4e55e492ee2caafd399ad19df0e7a: Status 404 returned error can't find the container with id 472deb10a9a5bc99e2329533b1032f0ec1a4e55e492ee2caafd399ad19df0e7a
Jul 20 15:35:24.810582 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:24.810531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v" event={"ID":"9acd2dea-c08f-4e74-8232-a4e5dcf0144d","Type":"ContainerStarted","Data":"472deb10a9a5bc99e2329533b1032f0ec1a4e55e492ee2caafd399ad19df0e7a"}
Jul 20 15:35:30.170478 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:30.170441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:30.170494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:35:30.170600    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:35:30.170608    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:35:30.170631    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:35:30.170665    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:36:34.170650609 +0000 UTC m=+162.712378270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:35:30.170983 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:35:30.170687    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:36:34.170673608 +0000 UTC m=+162.712401270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:35:34.768369 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:34.768339    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c7bjv"
Jul 20 15:35:48.867671 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:48.867635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v" event={"ID":"9acd2dea-c08f-4e74-8232-a4e5dcf0144d","Type":"ContainerStarted","Data":"d43829e8f093103c510e26df9bc341cf0d09e98ee3006e137ac1603ccf93f471"}
Jul 20 15:35:48.868181 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:48.867870    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:48.869424 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:48.869402    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:35:48.884145 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:35:48.884102    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v" podStartSLOduration=2.206199474 podStartE2EDuration="25.884088829s" totalImagesPullingTime="23.677889355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:35:48.882626706 +0000 UTC m=+117.424354389" watchObservedRunningTime="2026-07-20 15:35:48.884088829 +0000 UTC m=+117.425816513"
Jul 20 15:36:02.197498 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:02.197444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:36:02.198028 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:02.197599    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 15:36:02.198028 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:02.197666    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:04.197651283 +0000 UTC m=+252.739378945 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : secret "metrics-daemon-secret" not found
Jul 20 15:36:29.262224 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:29.262184    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a"
Jul 20 15:36:29.283539 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:29.283515    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9dhxp" podUID="bccab366-ff18-488f-982e-1ba9be77e312"
Jul 20 15:36:29.526506 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:29.526401    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:36:29.962391 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:29.962357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:36:29.962391 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:29.962387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:36:34.208215 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:34.208161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:36:34.208215 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:34.208223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:36:34.208717 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:34.208319    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:36:34.208717 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:34.208332    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:36:34.208717 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:34.208357    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-579b8fb87-9nrx8: secret "image-registry-tls" not found
Jul 20 15:36:34.208717 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:34.208370    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls podName:bccab366-ff18-488f-982e-1ba9be77e312 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:36.208355662 +0000 UTC m=+284.750083325 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls") pod "dns-default-9dhxp" (UID: "bccab366-ff18-488f-982e-1ba9be77e312") : secret "dns-default-metrics-tls" not found
Jul 20 15:36:34.208717 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:36:34.208413    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls podName:71a17f6c-b2c1-47f6-88d2-47d63ffc337a nodeName:}" failed. No retries permitted until 2026-07-20 15:38:36.208395522 +0000 UTC m=+284.750123186 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls") pod "image-registry-579b8fb87-9nrx8" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a") : secret "image-registry-tls" not found
Jul 20 15:36:41.493938 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:36:41.493889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:37:48.143695 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:48.143658    2558 generic.go:356] "Generic (PLEG): container finished" podID="9acd2dea-c08f-4e74-8232-a4e5dcf0144d" containerID="d43829e8f093103c510e26df9bc341cf0d09e98ee3006e137ac1603ccf93f471" exitCode=1
Jul 20 15:37:48.144105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:48.143731    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v" event={"ID":"9acd2dea-c08f-4e74-8232-a4e5dcf0144d","Type":"ContainerDied","Data":"d43829e8f093103c510e26df9bc341cf0d09e98ee3006e137ac1603ccf93f471"}
Jul 20 15:37:48.144105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:48.144029    2558 scope.go:117] "RemoveContainer" containerID="d43829e8f093103c510e26df9bc341cf0d09e98ee3006e137ac1603ccf93f471"
Jul 20 15:37:48.868079 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:48.868038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:37:49.148094 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:49.148055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v" event={"ID":"9acd2dea-c08f-4e74-8232-a4e5dcf0144d","Type":"ContainerStarted","Data":"ff044e7a285d99ee87bc6fc550d7a6ecb51604fe0f35436246f0870972b540bc"}
Jul 20 15:37:49.148497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:49.148272    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:37:49.148840 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:49.148823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b794f9fb4-kw78v"
Jul 20 15:37:50.100534 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.100495    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"]
Jul 20 15:37:50.103469 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.103446    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.107622 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.107599    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 15:37:50.107622 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.107617    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 15:37:50.107808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.107654    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5dp7b\""
Jul 20 15:37:50.124857 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.124832    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"]
Jul 20 15:37:50.127451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.127436    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.133638 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.133614    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret"
Jul 20 15:37:50.133789 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.133739    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-cnzjk\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cnzjk\"" type="*v1.Secret"
Jul 20 15:37:50.133914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.133811    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-operator-config\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap"
Jul 20 15:37:50.133914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.133825    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 20 15:37:50.133914 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.133846    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 20 15:37:50.149101 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.149078    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"]
Jul 20 15:37:50.163772 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.163734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"]
Jul 20 15:37:50.231073 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.231042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.231259 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.231085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59f9398-dda2-4c84-b87f-6fa776cf9673-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.231259 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.231102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnzbk\" (UniqueName: \"kubernetes.io/projected/c59f9398-dda2-4c84-b87f-6fa776cf9673-kube-api-access-mnzbk\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.231259 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.231171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e6865653-823f-49bb-a89d-ad1df0cdf98b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.231391 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.231256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59f9398-dda2-4c84-b87f-6fa776cf9673-config\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.331911 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.331877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e6865653-823f-49bb-a89d-ad1df0cdf98b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.332104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.331935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59f9398-dda2-4c84-b87f-6fa776cf9673-config\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.332104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.331986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.332104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.332049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59f9398-dda2-4c84-b87f-6fa776cf9673-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.332235 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.332130    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:37:50.332235 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.332166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnzbk\" (UniqueName: \"kubernetes.io/projected/c59f9398-dda2-4c84-b87f-6fa776cf9673-kube-api-access-mnzbk\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:50.332235 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.332201    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:37:50.832184745 +0000 UTC m=+239.373912407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:37:50.332611 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.332595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e6865653-823f-49bb-a89d-ad1df0cdf98b-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.339278 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.339252    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"]
Jul 20 15:37:50.342031 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.342015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"
Jul 20 15:37:50.367069 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.367019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gdhrr\""
Jul 20 15:37:50.372182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.372161    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"]
Jul 20 15:37:50.374942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.374924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.387500 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.387475    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 20 15:37:50.388033 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.388015    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap"
Jul 20 15:37:50.388436 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.388418    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-t5sgq\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t5sgq\"" type="*v1.Secret"
Jul 20 15:37:50.398821 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.398803    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:37:50.399267 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.399252    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 15:37:50.418283 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.418262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"]
Jul 20 15:37:50.419038 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.419022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"]
Jul 20 15:37:50.433390 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.433365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4nbv\" (UniqueName: \"kubernetes.io/projected/0db8b25b-a0de-46ad-a42a-1fb88b907065-kube-api-access-b4nbv\") pod \"network-check-source-7bc5b6bf85-mvgbz\" (UID: \"0db8b25b-a0de-46ad-a42a-1fb88b907065\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"
Jul 20 15:37:50.534308 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.534261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4nbv\" (UniqueName: \"kubernetes.io/projected/0db8b25b-a0de-46ad-a42a-1fb88b907065-kube-api-access-b4nbv\") pod \"network-check-source-7bc5b6bf85-mvgbz\" (UID: \"0db8b25b-a0de-46ad-a42a-1fb88b907065\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"
Jul 20 15:37:50.534509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.534371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjln2\" (UniqueName: \"kubernetes.io/projected/3479d0c3-482d-4d34-a112-af3628a4e741-kube-api-access-xjln2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.534509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.534394    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3479d0c3-482d-4d34-a112-af3628a4e741-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.534509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.534409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3479d0c3-482d-4d34-a112-af3628a4e741-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.544878 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.544858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4nbv\" (UniqueName: \"kubernetes.io/projected/0db8b25b-a0de-46ad-a42a-1fb88b907065-kube-api-access-b4nbv\") pod \"network-check-source-7bc5b6bf85-mvgbz\" (UID: \"0db8b25b-a0de-46ad-a42a-1fb88b907065\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"
Jul 20 15:37:50.634734 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.634706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjln2\" (UniqueName: \"kubernetes.io/projected/3479d0c3-482d-4d34-a112-af3628a4e741-kube-api-access-xjln2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.634858 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.634744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3479d0c3-482d-4d34-a112-af3628a4e741-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.634858 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.634785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3479d0c3-482d-4d34-a112-af3628a4e741-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.637006 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.636981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3479d0c3-482d-4d34-a112-af3628a4e741-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:50.650227 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.650207    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"
Jul 20 15:37:50.770009 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.769979    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz"]
Jul 20 15:37:50.772422 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:37:50.772399    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db8b25b_a0de_46ad_a42a_1fb88b907065.slice/crio-c0d6b7b87feccb8c92f5506e9f44e95cb4921f0d04d88a30c77ea41498066bde WatchSource:0}: Error finding container c0d6b7b87feccb8c92f5506e9f44e95cb4921f0d04d88a30c77ea41498066bde: Status 404 returned error can't find the container with id c0d6b7b87feccb8c92f5506e9f44e95cb4921f0d04d88a30c77ea41498066bde
Jul 20 15:37:50.836609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:50.836588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:50.836727 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.836715    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:37:50.836789 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:50.836775    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:37:51.836761889 +0000 UTC m=+240.378489550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:37:51.029624 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.029542    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 20 15:37:51.033095 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.033071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c59f9398-dda2-4c84-b87f-6fa776cf9673-config\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:51.154764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.154710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz" event={"ID":"0db8b25b-a0de-46ad-a42a-1fb88b907065","Type":"ContainerStarted","Data":"c89dc28780d9a32c481a2b147ba0195ccce4465f6a7ffd1982355448d798daf8"}
Jul 20 15:37:51.155132 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.154781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz" event={"ID":"0db8b25b-a0de-46ad-a42a-1fb88b907065","Type":"ContainerStarted","Data":"c0d6b7b87feccb8c92f5506e9f44e95cb4921f0d04d88a30c77ea41498066bde"}
Jul 20 15:37:51.158337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.158313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 20 15:37:51.164923 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.164897    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c59f9398-dda2-4c84-b87f-6fa776cf9673-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:51.169122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.169105    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cnzjk\""
Jul 20 15:37:51.175221 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.175182    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mvgbz" podStartSLOduration=1.175169966 podStartE2EDuration="1.175169966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:37:51.174742188 +0000 UTC m=+239.716469873" watchObservedRunningTime="2026-07-20 15:37:51.175169966 +0000 UTC m=+239.716897649"
Jul 20 15:37:51.267238 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.267212    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 20 15:37:51.318692 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.318635    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 15:37:51.329400 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.329377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjln2\" (UniqueName: \"kubernetes.io/projected/3479d0c3-482d-4d34-a112-af3628a4e741-kube-api-access-xjln2\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:51.361174 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.361154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 15:37:51.366187 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.366169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3479d0c3-482d-4d34-a112-af3628a4e741-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gvt97\" (UID: \"3479d0c3-482d-4d34-a112-af3628a4e741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:51.493792 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.493762    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t5sgq\""
Jul 20 15:37:51.582389 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.582309    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"
Jul 20 15:37:51.674016 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.673990    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:37:51.678714 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.678690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnzbk\" (UniqueName: \"kubernetes.io/projected/c59f9398-dda2-4c84-b87f-6fa776cf9673-kube-api-access-mnzbk\") pod \"service-ca-operator-5bcbc94c78-dsnnk\" (UID: \"c59f9398-dda2-4c84-b87f-6fa776cf9673\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:51.711981 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.711653    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97"]
Jul 20 15:37:51.714254 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:37:51.714229    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3479d0c3_482d_4d34_a112_af3628a4e741.slice/crio-761cc885e9a82d1670950ccf65237cd27464b2edb28c172a17b0295b389d24be WatchSource:0}: Error finding container 761cc885e9a82d1670950ccf65237cd27464b2edb28c172a17b0295b389d24be: Status 404 returned error can't find the container with id 761cc885e9a82d1670950ccf65237cd27464b2edb28c172a17b0295b389d24be
Jul 20 15:37:51.845484 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.845396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:51.845637 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:51.845524    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:37:51.845637 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:51.845591    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:37:53.845571652 +0000 UTC m=+242.387299315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:37:51.935391 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:51.935361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"
Jul 20 15:37:52.080689 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:52.080656    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk"]
Jul 20 15:37:52.083583 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:37:52.083557    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59f9398_dda2_4c84_b87f_6fa776cf9673.slice/crio-6d697779f410cf32602a1a1af9d865151131ec6cef0a2981f4a65b15ddfeb85a WatchSource:0}: Error finding container 6d697779f410cf32602a1a1af9d865151131ec6cef0a2981f4a65b15ddfeb85a: Status 404 returned error can't find the container with id 6d697779f410cf32602a1a1af9d865151131ec6cef0a2981f4a65b15ddfeb85a
Jul 20 15:37:52.163052 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:52.163015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97" event={"ID":"3479d0c3-482d-4d34-a112-af3628a4e741","Type":"ContainerStarted","Data":"761cc885e9a82d1670950ccf65237cd27464b2edb28c172a17b0295b389d24be"}
Jul 20 15:37:52.164472 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:52.164407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk" event={"ID":"c59f9398-dda2-4c84-b87f-6fa776cf9673","Type":"ContainerStarted","Data":"6d697779f410cf32602a1a1af9d865151131ec6cef0a2981f4a65b15ddfeb85a"}
Jul 20 15:37:53.861713 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:53.861668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:53.862271 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:53.861831    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:37:53.862271 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:53.861899    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:37:57.861882824 +0000 UTC m=+246.403610492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:37:54.172431 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.172398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97" event={"ID":"3479d0c3-482d-4d34-a112-af3628a4e741","Type":"ContainerStarted","Data":"dad3259fdb2c86e0d5e47f80288b633105d50b36be87a3744d099d284f6e4b09"}
Jul 20 15:37:54.173938 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.173915    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk" event={"ID":"c59f9398-dda2-4c84-b87f-6fa776cf9673","Type":"ContainerStarted","Data":"b87fa5472371a3b66f458c360aa76af589835ae0b15f4753f2f51b45e54d480a"}
Jul 20 15:37:54.207510 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.207480    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w9s6q"]
Jul 20 15:37:54.210914 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.210895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.214504 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:54.214481    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 20 15:37:54.214602 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:54.214571    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 20 15:37:54.215081 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.215047    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 15:37:54.215081 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.215062    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 15:37:54.215218 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.215182    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cwjrs\""
Jul 20 15:37:54.257569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.257539    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9s6q"]
Jul 20 15:37:54.299661 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.299603    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97" podStartSLOduration=2.065996022 podStartE2EDuration="4.299581998s" totalImagesPullingTime="2.233585976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:37:54.267551984 +0000 UTC m=+242.809279667" watchObservedRunningTime="2026-07-20 15:37:54.299581998 +0000 UTC m=+242.841309663"
Jul 20 15:37:54.326230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.326175    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk" podStartSLOduration=2.458530032 podStartE2EDuration="4.326155194s" totalImagesPullingTime="1.867625162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:37:54.324459762 +0000 UTC m=+242.866187446" watchObservedRunningTime="2026-07-20 15:37:54.326155194 +0000 UTC m=+242.867882877"
Jul 20 15:37:54.365259 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.365218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.365436 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.365270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzdmt\" (UniqueName: \"kubernetes.io/projected/786b9372-fee5-4d4a-a407-79907a7131e9-kube-api-access-fzdmt\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.365436 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.365360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/786b9372-fee5-4d4a-a407-79907a7131e9-crio-socket\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.365554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.365447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.365554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.365516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/786b9372-fee5-4d4a-a407-79907a7131e9-data-volume\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466342 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/786b9372-fee5-4d4a-a407-79907a7131e9-data-volume\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzdmt\" (UniqueName: \"kubernetes.io/projected/786b9372-fee5-4d4a-a407-79907a7131e9-kube-api-access-fzdmt\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/786b9372-fee5-4d4a-a407-79907a7131e9-crio-socket\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466636 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/786b9372-fee5-4d4a-a407-79907a7131e9-crio-socket\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.466674 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.466635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/786b9372-fee5-4d4a-a407-79907a7131e9-data-volume\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:54.483299 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:54.483264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzdmt\" (UniqueName: \"kubernetes.io/projected/786b9372-fee5-4d4a-a407-79907a7131e9-kube-api-access-fzdmt\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:55.452554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.452522    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 15:37:55.457200 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.457176    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:55.457299 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.457241    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:55.957225012 +0000 UTC m=+244.498952677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:55.466998 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.466979    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition
Jul 20 15:37:55.467117 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.467038    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:55.967025294 +0000 UTC m=+244.508752959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : failed to sync configmap cache: timed out waiting for the condition
Jul 20 15:37:55.495607 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.495582    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 15:37:55.640397 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.640360    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"]
Jul 20 15:37:55.643789 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.643767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"
Jul 20 15:37:55.646361 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.646342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gfvth\""
Jul 20 15:37:55.646809 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.646792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 15:37:55.647262 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.647240    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 15:37:55.654866 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.654847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"]
Jul 20 15:37:55.776814 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.776725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrcx\" (UniqueName: \"kubernetes.io/projected/5cebc1f5-dec4-41d8-a937-5d310fd2c351-kube-api-access-gjrcx\") pod \"migrator-7cc9c7ffd7-sb5rq\" (UID: \"5cebc1f5-dec4-41d8-a937-5d310fd2c351\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"
Jul 20 15:37:55.878035 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.877997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrcx\" (UniqueName: \"kubernetes.io/projected/5cebc1f5-dec4-41d8-a937-5d310fd2c351-kube-api-access-gjrcx\") pod \"migrator-7cc9c7ffd7-sb5rq\" (UID: \"5cebc1f5-dec4-41d8-a937-5d310fd2c351\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"
Jul 20 15:37:55.887545 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.887514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrcx\" (UniqueName: \"kubernetes.io/projected/5cebc1f5-dec4-41d8-a937-5d310fd2c351-kube-api-access-gjrcx\") pod \"migrator-7cc9c7ffd7-sb5rq\" (UID: \"5cebc1f5-dec4-41d8-a937-5d310fd2c351\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"
Jul 20 15:37:55.953137 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.953093    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"
Jul 20 15:37:55.979406 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.979373    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:55.979543 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:55.979474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:55.979543 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.979506    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:37:55.979646 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.979584    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:56.979562415 +0000 UTC m=+245.521290079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : configmap "kube-rbac-proxy" not found
Jul 20 15:37:55.979646 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.979616    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:55.979774 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:55.979684    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:56.979667568 +0000 UTC m=+245.521395231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:56.084172 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.084135    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq"]
Jul 20 15:37:56.087686 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:37:56.087658    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cebc1f5_dec4_41d8_a937_5d310fd2c351.slice/crio-79fc25477d369b96bb63b4d8406377e6767bb2de13ca690a1deb31ac637cfa74 WatchSource:0}: Error finding container 79fc25477d369b96bb63b4d8406377e6767bb2de13ca690a1deb31ac637cfa74: Status 404 returned error can't find the container with id 79fc25477d369b96bb63b4d8406377e6767bb2de13ca690a1deb31ac637cfa74
Jul 20 15:37:56.168408 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.168377    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxxsq_b1953acb-7e74-4ebd-a62c-fd91964d2f5c/dns-node-resolver/0.log"
Jul 20 15:37:56.180697 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.180669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq" event={"ID":"5cebc1f5-dec4-41d8-a937-5d310fd2c351","Type":"ContainerStarted","Data":"79fc25477d369b96bb63b4d8406377e6767bb2de13ca690a1deb31ac637cfa74"}
Jul 20 15:37:56.968316 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.968288    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n4ls_23f3f052-b32c-4827-8db6-50391261ae83/node-ca/0.log"
Jul 20 15:37:56.986593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.986564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:56.986723 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:56.986634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:56.986723 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:56.986718    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:56.986811 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:56.986786    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:58.986770995 +0000 UTC m=+247.528498659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:56.986811 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:56.986721    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:37:56.986920 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:56.986843    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:37:58.986831265 +0000 UTC m=+247.528558927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : configmap "kube-rbac-proxy" not found
Jul 20 15:37:57.340704 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.340624    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qlpkp"]
Jul 20 15:37:57.343817 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.343796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.345895 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.345870    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 15:37:57.346356 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.346271    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 15:37:57.346471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.346358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 15:37:57.346471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.346386    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 15:37:57.346471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.346438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gcdqx\""
Jul 20 15:37:57.356503 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.356483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qlpkp"]
Jul 20 15:37:57.491929 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.491892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqpw\" (UniqueName: \"kubernetes.io/projected/4433b970-63e3-41f0-98f8-16a8d13f943a-kube-api-access-dvqpw\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.492117 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.491986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-key\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.492117 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.492010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-cabundle\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.593129 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.593074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqpw\" (UniqueName: \"kubernetes.io/projected/4433b970-63e3-41f0-98f8-16a8d13f943a-kube-api-access-dvqpw\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.593231 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.593157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-key\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.593231 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.593186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-cabundle\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.593928 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.593903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-cabundle\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.595683 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.595664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4433b970-63e3-41f0-98f8-16a8d13f943a-signing-key\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.601544 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.601521    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqpw\" (UniqueName: \"kubernetes.io/projected/4433b970-63e3-41f0-98f8-16a8d13f943a-kube-api-access-dvqpw\") pod \"service-ca-58598695f7-qlpkp\" (UID: \"4433b970-63e3-41f0-98f8-16a8d13f943a\") " pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.653576 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.653549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qlpkp"
Jul 20 15:37:57.783501 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.783470    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qlpkp"]
Jul 20 15:37:57.786532 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:37:57.786500    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4433b970_63e3_41f0_98f8_16a8d13f943a.slice/crio-7a1b8763c6926f96cc2f002e7ed3885e61b9f6a5252f647f9050cf3de2d85447 WatchSource:0}: Error finding container 7a1b8763c6926f96cc2f002e7ed3885e61b9f6a5252f647f9050cf3de2d85447: Status 404 returned error can't find the container with id 7a1b8763c6926f96cc2f002e7ed3885e61b9f6a5252f647f9050cf3de2d85447
Jul 20 15:37:57.896882 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:57.896843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:37:57.897059 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:57.896969    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:37:57.897059 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:57.897020    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:38:05.897006292 +0000 UTC m=+254.438733955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:37:58.169576 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.169496    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzx4m_8be52aba-60eb-46d6-935a-cc9be9ff19f9/serve-healthcheck-canary/0.log"
Jul 20 15:37:58.187288 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.187253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qlpkp" event={"ID":"4433b970-63e3-41f0-98f8-16a8d13f943a","Type":"ContainerStarted","Data":"778f34138847ba9e334f7fa92f093afeafacdf9df74266fcb55a63e7eef21cb2"}
Jul 20 15:37:58.187455 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.187306    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qlpkp" event={"ID":"4433b970-63e3-41f0-98f8-16a8d13f943a","Type":"ContainerStarted","Data":"7a1b8763c6926f96cc2f002e7ed3885e61b9f6a5252f647f9050cf3de2d85447"}
Jul 20 15:37:58.189004 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.188982    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq" event={"ID":"5cebc1f5-dec4-41d8-a937-5d310fd2c351","Type":"ContainerStarted","Data":"7872353cb404f02676c2ecc646883f86573cf4a1446b5604d39b962422f81184"}
Jul 20 15:37:58.189126 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.189020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq" event={"ID":"5cebc1f5-dec4-41d8-a937-5d310fd2c351","Type":"ContainerStarted","Data":"8eaaf39ab4fac7d2d52cfe67283025b9fe9e8f44f8e87f020f44eaee99ad6320"}
Jul 20 15:37:58.210492 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:58.210445    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-qlpkp" podStartSLOduration=1.210431912 podStartE2EDuration="1.210431912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:37:58.20996708 +0000 UTC m=+246.751694763" watchObservedRunningTime="2026-07-20 15:37:58.210431912 +0000 UTC m=+246.752159596"
Jul 20 15:37:59.007911 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:59.007875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:59.008072 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:37:59.007942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:37:59.008072 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:59.008011    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:37:59.008164 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:59.008078    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:37:59.008164 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:59.008088    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:03.008072249 +0000 UTC m=+251.549799915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : configmap "kube-rbac-proxy" not found
Jul 20 15:37:59.008164 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:37:59.008118    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:03.008107404 +0000 UTC m=+251.549835066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:03.038297 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:03.038264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:03.038694 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:03.038435    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:03.038694 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:03.038485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:03.038694 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:03.038510    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:11.038492071 +0000 UTC m=+259.580219748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:03.038694 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:03.038549    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:03.038694 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:03.038593    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm podName:786b9372-fee5-4d4a-a407-79907a7131e9 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:11.038581874 +0000 UTC m=+259.580309553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w9s6q" (UID: "786b9372-fee5-4d4a-a407-79907a7131e9") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:04.247944 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:04.247901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:38:04.248328 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:04.248050    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 15:38:04.248328 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:04.248109    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs podName:386c94ce-047f-419e-bc49-db7d3da7f6a6 nodeName:}" failed. No retries permitted until 2026-07-20 15:40:06.248095016 +0000 UTC m=+374.789822680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs") pod "network-metrics-daemon-hfwdl" (UID: "386c94ce-047f-419e-bc49-db7d3da7f6a6") : secret "metrics-daemon-secret" not found
Jul 20 15:38:05.959255 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:05.959217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:38:05.959870 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:05.959375    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 15:38:05.959870 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:05.959437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert podName:e6865653-823f-49bb-a89d-ad1df0cdf98b nodeName:}" failed. No retries permitted until 2026-07-20 15:38:21.959422592 +0000 UTC m=+270.501150254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-w7t8g" (UID: "e6865653-823f-49bb-a89d-ad1df0cdf98b") : secret "networking-console-plugin-cert" not found
Jul 20 15:38:11.100639 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.100596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:11.101051 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.100675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:11.101142 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.101126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/786b9372-fee5-4d4a-a407-79907a7131e9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:11.102936 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.102917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/786b9372-fee5-4d4a-a407-79907a7131e9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w9s6q\" (UID: \"786b9372-fee5-4d4a-a407-79907a7131e9\") " pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:11.319693 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.319664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w9s6q"
Jul 20 15:38:11.452289 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.452229    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-sb5rq" podStartSLOduration=14.966948849 podStartE2EDuration="16.452208784s" totalImagesPullingTime="1.485259935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:37:58.235500698 +0000 UTC m=+246.777228384" watchObservedRunningTime="2026-07-20 15:38:11.452208784 +0000 UTC m=+259.993936472"
Jul 20 15:38:11.452431 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:11.452400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w9s6q"]
Jul 20 15:38:11.455818 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:11.455793    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786b9372_fee5_4d4a_a407_79907a7131e9.slice/crio-029e19634627892f0617b3d485e1407b8a650a19a977e3bcf8c1012aff3fc8b7 WatchSource:0}: Error finding container 029e19634627892f0617b3d485e1407b8a650a19a977e3bcf8c1012aff3fc8b7: Status 404 returned error can't find the container with id 029e19634627892f0617b3d485e1407b8a650a19a977e3bcf8c1012aff3fc8b7
Jul 20 15:38:12.246411 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:12.246318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9s6q" event={"ID":"786b9372-fee5-4d4a-a407-79907a7131e9","Type":"ContainerStarted","Data":"029e19634627892f0617b3d485e1407b8a650a19a977e3bcf8c1012aff3fc8b7"}
Jul 20 15:38:17.265698 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:17.265661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9s6q" event={"ID":"786b9372-fee5-4d4a-a407-79907a7131e9","Type":"ContainerStarted","Data":"d724bc89f36191355843b5ee82dda52f3da99d311997982acc30e74c9f06e2f0"}
Jul 20 15:38:20.278617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:20.278580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9s6q" event={"ID":"786b9372-fee5-4d4a-a407-79907a7131e9","Type":"ContainerStarted","Data":"076d651c416b54961e7ebc4b635afb73a9a6eaa6767fe1c0fe4d74955f8a0841"}
Jul 20 15:38:21.993492 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:21.993448    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:38:21.996131 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:21.996102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e6865653-823f-49bb-a89d-ad1df0cdf98b-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-w7t8g\" (UID: \"e6865653-823f-49bb-a89d-ad1df0cdf98b\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:38:22.214060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:22.214022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5dp7b\""
Jul 20 15:38:22.222067 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:22.222039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"
Jul 20 15:38:23.168341 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:23.168317    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g"]
Jul 20 15:38:23.172139 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:23.172108    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6865653_823f_49bb_a89d_ad1df0cdf98b.slice/crio-523dd2573a8be7fd4e07d7befd2252927ba02835c2fe07082b278d55cdf3abf0 WatchSource:0}: Error finding container 523dd2573a8be7fd4e07d7befd2252927ba02835c2fe07082b278d55cdf3abf0: Status 404 returned error can't find the container with id 523dd2573a8be7fd4e07d7befd2252927ba02835c2fe07082b278d55cdf3abf0
Jul 20 15:38:23.289686 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:23.289614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g" event={"ID":"e6865653-823f-49bb-a89d-ad1df0cdf98b","Type":"ContainerStarted","Data":"523dd2573a8be7fd4e07d7befd2252927ba02835c2fe07082b278d55cdf3abf0"}
Jul 20 15:38:23.291515 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:23.291492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w9s6q" event={"ID":"786b9372-fee5-4d4a-a407-79907a7131e9","Type":"ContainerStarted","Data":"2d3f6433e9a45836830f895a264e0d9547fac3fd2d56d5f6f3bb8c0f67a6ea19"}
Jul 20 15:38:23.314845 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:23.314802    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w9s6q" podStartSLOduration=17.813312178 podStartE2EDuration="29.314788247s" totalImagesPullingTime="11.501476069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:37:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:23.31366867 +0000 UTC m=+271.855396372" watchObservedRunningTime="2026-07-20 15:38:23.314788247 +0000 UTC m=+271.856515930"
Jul 20 15:38:24.295809 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:24.295782    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g" event={"ID":"e6865653-823f-49bb-a89d-ad1df0cdf98b","Type":"ContainerStarted","Data":"8e3c3b9005248c13dbdae72e5da5a5e56c457766de68b5430ad56adcc593932c"}
Jul 20 15:38:24.316810 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:24.316767    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-w7t8g" podStartSLOduration=33.277085355 podStartE2EDuration="34.316736401s" totalImagesPullingTime="1.039651046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:24.315909512 +0000 UTC m=+272.857637233" watchObservedRunningTime="2026-07-20 15:38:24.316736401 +0000 UTC m=+272.858464085"
Jul 20 15:38:32.963021 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:32.962966    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9dhxp" podUID="bccab366-ff18-488f-982e-1ba9be77e312"
Jul 20 15:38:32.963021 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:32.962974    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a"
Jul 20 15:38:33.324332 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.324256    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:33.324332 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.324272    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:33.641554 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.641526    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"]
Jul 20 15:38:33.647023 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.646996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.651587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.651553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 15:38:33.652474 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.652456    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 15:38:33.652822 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.652803    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 15:38:33.652927 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.652882    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jnsw9\""
Jul 20 15:38:33.652977 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.652968    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 15:38:33.653090 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.653075    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 15:38:33.664228 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.663736    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"]
Jul 20 15:38:33.712738 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.712708    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ckc2b"]
Jul 20 15:38:33.716346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.716329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.718698 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.718673    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8trzz\""
Jul 20 15:38:33.718947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.718926    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 15:38:33.719193 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.719174    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 15:38:33.719291 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.719272    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 15:38:33.779685 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-sys\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.779834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7517365c-1b8b-4559-8742-1049876fb64d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.779834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-metrics-client-ca\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.779834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.779834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-textfile\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.780002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.780002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-root\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.780002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-wtmp\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.780002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.780002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.779987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7cv\" (UniqueName: \"kubernetes.io/projected/e4346d78-702e-4ccf-b928-995773609c6f-kube-api-access-zb7cv\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.780179 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.780010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.780179 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.780028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr6g7\" (UniqueName: \"kubernetes.io/projected/7517365c-1b8b-4559-8742-1049876fb64d-kube-api-access-cr6g7\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.780179 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.780051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-tls\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.880714 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-sys\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.880714 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7517365c-1b8b-4559-8742-1049876fb64d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-metrics-client-ca\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-sys\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-textfile\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-root\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-wtmp\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.880976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-root\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7cv\" (UniqueName: \"kubernetes.io/projected/e4346d78-702e-4ccf-b928-995773609c6f-kube-api-access-zb7cv\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr6g7\" (UniqueName: \"kubernetes.io/projected/7517365c-1b8b-4559-8742-1049876fb64d-kube-api-access-cr6g7\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-wtmp\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-tls\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-metrics-client-ca\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881431    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.881569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7517365c-1b8b-4559-8742-1049876fb64d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.881896 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.881711    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-textfile\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.883629 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.883606    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.883733 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.883615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-tls\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.883733 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.883669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4346d78-702e-4ccf-b928-995773609c6f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.883827 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.883769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7517365c-1b8b-4559-8742-1049876fb64d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.894705 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.894652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr6g7\" (UniqueName: \"kubernetes.io/projected/7517365c-1b8b-4559-8742-1049876fb64d-kube-api-access-cr6g7\") pod \"openshift-state-metrics-79f6958cdf-jrnr5\" (UID: \"7517365c-1b8b-4559-8742-1049876fb64d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:33.895330 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.895308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7cv\" (UniqueName: \"kubernetes.io/projected/e4346d78-702e-4ccf-b928-995773609c6f-kube-api-access-zb7cv\") pod \"node-exporter-ckc2b\" (UID: \"e4346d78-702e-4ccf-b928-995773609c6f\") " pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:33.958987 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:33.958958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"
Jul 20 15:38:34.027091 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.027061    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckc2b"
Jul 20 15:38:34.038663 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:34.038629    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4346d78_702e_4ccf_b928_995773609c6f.slice/crio-fbd4ce3241226f0c2c02e14b0106a9196feb58a77599ffc056585244270e37e9 WatchSource:0}: Error finding container fbd4ce3241226f0c2c02e14b0106a9196feb58a77599ffc056585244270e37e9: Status 404 returned error can't find the container with id fbd4ce3241226f0c2c02e14b0106a9196feb58a77599ffc056585244270e37e9
Jul 20 15:38:34.090408 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.090378    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5"]
Jul 20 15:38:34.093688 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:34.093658    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7517365c_1b8b_4559_8742_1049876fb64d.slice/crio-bb593be58bd814c9bf1c090adf3a28ab7d7f41fd42564a3cf52fef2e489bd578 WatchSource:0}: Error finding container bb593be58bd814c9bf1c090adf3a28ab7d7f41fd42564a3cf52fef2e489bd578: Status 404 returned error can't find the container with id bb593be58bd814c9bf1c090adf3a28ab7d7f41fd42564a3cf52fef2e489bd578
Jul 20 15:38:34.329150 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.329109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckc2b" event={"ID":"e4346d78-702e-4ccf-b928-995773609c6f","Type":"ContainerStarted","Data":"fbd4ce3241226f0c2c02e14b0106a9196feb58a77599ffc056585244270e37e9"}
Jul 20 15:38:34.331006 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.330972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5" event={"ID":"7517365c-1b8b-4559-8742-1049876fb64d","Type":"ContainerStarted","Data":"45d5256731b299c7e05ccb9f28debc50dfe43f5731542863e5e1b0275c15949d"}
Jul 20 15:38:34.331136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.331038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5" event={"ID":"7517365c-1b8b-4559-8742-1049876fb64d","Type":"ContainerStarted","Data":"a244731105d36f71e0c8150f817c42a3656d83e4048e223a1cf33c79253ea674"}
Jul 20 15:38:34.331136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:34.331067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5" event={"ID":"7517365c-1b8b-4559-8742-1049876fb64d","Type":"ContainerStarted","Data":"bb593be58bd814c9bf1c090adf3a28ab7d7f41fd42564a3cf52fef2e489bd578"}
Jul 20 15:38:36.303626 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.303578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:36.304032 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.303657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:36.305952 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.305930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bccab366-ff18-488f-982e-1ba9be77e312-metrics-tls\") pod \"dns-default-9dhxp\" (UID: \"bccab366-ff18-488f-982e-1ba9be77e312\") " pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:36.306053 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.305948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"image-registry-579b8fb87-9nrx8\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") " pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:36.328255 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.328229    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptfkc\""
Jul 20 15:38:36.328339 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.328231    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7h8p6\""
Jul 20 15:38:36.335292 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.335270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:36.335414 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.335310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:36.338735 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.338715    2558 generic.go:356] "Generic (PLEG): container finished" podID="e4346d78-702e-4ccf-b928-995773609c6f" containerID="20d5d4abca46eaecb9dcb1089de828571a48d06b5628e51c4bf954e58ef534f7" exitCode=0
Jul 20 15:38:36.338841 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.338803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckc2b" event={"ID":"e4346d78-702e-4ccf-b928-995773609c6f","Type":"ContainerDied","Data":"20d5d4abca46eaecb9dcb1089de828571a48d06b5628e51c4bf954e58ef534f7"}
Jul 20 15:38:36.340976 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.340951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5" event={"ID":"7517365c-1b8b-4559-8742-1049876fb64d","Type":"ContainerStarted","Data":"752a9e84301ef20f575a4be134f92f8240dd60da8f753385e7149e99a6a9d1bd"}
Jul 20 15:38:36.412421 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.411280    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-jrnr5" podStartSLOduration=2.297579524 podStartE2EDuration="3.411256777s" totalImagesPullingTime="1.113677253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:36.410199 +0000 UTC m=+284.951926689" watchObservedRunningTime="2026-07-20 15:38:36.411256777 +0000 UTC m=+284.952984483"
Jul 20 15:38:36.516082 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.516046    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9dhxp"]
Jul 20 15:38:36.521847 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:36.521819    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccab366_ff18_488f_982e_1ba9be77e312.slice/crio-a9c0141a629b7926a8e5589eb951ac5a5d1b14197f56c22cd89d55a14584fd22 WatchSource:0}: Error finding container a9c0141a629b7926a8e5589eb951ac5a5d1b14197f56c22cd89d55a14584fd22: Status 404 returned error can't find the container with id a9c0141a629b7926a8e5589eb951ac5a5d1b14197f56c22cd89d55a14584fd22
Jul 20 15:38:36.562134 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:36.562068    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:38:36.567697 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:36.567675    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a17f6c_b2c1_47f6_88d2_47d63ffc337a.slice/crio-5b4b1b299999dbed79b3fe4bc6408d4b3175174848c125131da2070ff7733857 WatchSource:0}: Error finding container 5b4b1b299999dbed79b3fe4bc6408d4b3175174848c125131da2070ff7733857: Status 404 returned error can't find the container with id 5b4b1b299999dbed79b3fe4bc6408d4b3175174848c125131da2070ff7733857
Jul 20 15:38:37.197494 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.197461    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"]
Jul 20 15:38:37.201118 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.201094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.253571 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.253533    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 15:38:37.253918 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.253874    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6l4rv\""
Jul 20 15:38:37.253918 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.253890    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 15:38:37.254143 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.254127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 15:38:37.254995 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.254965    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 15:38:37.255139 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.255036    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6j7htl1t44l8e\""
Jul 20 15:38:37.255139 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.255041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 15:38:37.284819 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.284788    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"]
Jul 20 15:38:37.314299 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-grpc-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314387    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-metrics-client-ca\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7p6n\" (UniqueName: \"kubernetes.io/projected/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-kube-api-access-r7p6n\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.314654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.314537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.345229 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.345202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dhxp" event={"ID":"bccab366-ff18-488f-982e-1ba9be77e312","Type":"ContainerStarted","Data":"a9c0141a629b7926a8e5589eb951ac5a5d1b14197f56c22cd89d55a14584fd22"}
Jul 20 15:38:37.347089 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.347068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckc2b" event={"ID":"e4346d78-702e-4ccf-b928-995773609c6f","Type":"ContainerStarted","Data":"a64862336e2395e750f98b208e5be834a1d66c7a22024391427a496b2004978e"}
Jul 20 15:38:37.347187 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.347120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckc2b" event={"ID":"e4346d78-702e-4ccf-b928-995773609c6f","Type":"ContainerStarted","Data":"3f50e003808dba394d4a626965513dfc30d29d81951d4d0b054b2e36060af72d"}
Jul 20 15:38:37.348441 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.348420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" event={"ID":"71a17f6c-b2c1-47f6-88d2-47d63ffc337a","Type":"ContainerStarted","Data":"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"}
Jul 20 15:38:37.348520 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.348456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" event={"ID":"71a17f6c-b2c1-47f6-88d2-47d63ffc337a","Type":"ContainerStarted","Data":"5b4b1b299999dbed79b3fe4bc6408d4b3175174848c125131da2070ff7733857"}
Jul 20 15:38:37.415131 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-grpc-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415131 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415383 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415383 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415383 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-metrics-client-ca\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7p6n\" (UniqueName: \"kubernetes.io/projected/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-kube-api-access-r7p6n\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.415540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.415527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.416997 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.416943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-metrics-client-ca\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.418804 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.418288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.418804 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.418696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.418951 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.418826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-grpc-tls\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.418951 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.418837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.418951 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.418937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.419190 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.419171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.437187 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.437164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7p6n\" (UniqueName: \"kubernetes.io/projected/2852294b-28f2-4cd4-a1e3-6c3c6ec3068f-kube-api-access-r7p6n\") pod \"thanos-querier-57c45b7df6-hq6zg\" (UID: \"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f\") " pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.447685 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.447596    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" podStartSLOduration=263.447579384 podStartE2EDuration="4m23.447579384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:37.446359198 +0000 UTC m=+285.988086881" watchObservedRunningTime="2026-07-20 15:38:37.447579384 +0000 UTC m=+285.989307069"
Jul 20 15:38:37.497072 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.497028    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ckc2b" podStartSLOduration=3.153869538 podStartE2EDuration="4.497014127s" totalImagesPullingTime="1.278149984s" totalInitContainerRuntime="64.994605ms" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:37.496527096 +0000 UTC m=+286.038254780" watchObservedRunningTime="2026-07-20 15:38:37.497014127 +0000 UTC m=+286.038741810"
Jul 20 15:38:37.511673 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.511645    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:37.695475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:37.695329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"]
Jul 20 15:38:37.697934 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:38:37.697879    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2852294b_28f2_4cd4_a1e3_6c3c6ec3068f.slice/crio-7d94bd70f54c48671a9e29fb79c2f6d4be0f4cedcb37e36901a6c3156fb9cc1b WatchSource:0}: Error finding container 7d94bd70f54c48671a9e29fb79c2f6d4be0f4cedcb37e36901a6c3156fb9cc1b: Status 404 returned error can't find the container with id 7d94bd70f54c48671a9e29fb79c2f6d4be0f4cedcb37e36901a6c3156fb9cc1b
Jul 20 15:38:38.354149 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.354120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"7d94bd70f54c48671a9e29fb79c2f6d4be0f4cedcb37e36901a6c3156fb9cc1b"}
Jul 20 15:38:38.354425 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.354292    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:38.500200 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.500108    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"]
Jul 20 15:38:38.503573 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.503551    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:38.506550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.506496    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wlftl\""
Jul 20 15:38:38.506658 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.506568    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 15:38:38.535773 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.535734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"]
Jul 20 15:38:38.627046 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.627016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsf2f\" (UniqueName: \"kubernetes.io/projected/42621ed7-6705-4db2-ab8f-35efc1aeb727-kube-api-access-fsf2f\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:38.627203 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.627126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:38.728081 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.728049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsf2f\" (UniqueName: \"kubernetes.io/projected/42621ed7-6705-4db2-ab8f-35efc1aeb727-kube-api-access-fsf2f\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:38.728220 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.728148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:38.728311 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:38.728289    2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 20 15:38:38.728424 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:38.728353    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert podName:42621ed7-6705-4db2-ab8f-35efc1aeb727 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:39.228335845 +0000 UTC m=+287.770063512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-rs96q" (UID: "42621ed7-6705-4db2-ab8f-35efc1aeb727") : secret "monitoring-plugin-cert" not found
Jul 20 15:38:38.739323 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:38.739299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsf2f\" (UniqueName: \"kubernetes.io/projected/42621ed7-6705-4db2-ab8f-35efc1aeb727-kube-api-access-fsf2f\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:39.232985 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.232940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:39.235317 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.235292    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42621ed7-6705-4db2-ab8f-35efc1aeb727-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rs96q\" (UID: \"42621ed7-6705-4db2-ab8f-35efc1aeb727\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:39.361199 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.361165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dhxp" event={"ID":"bccab366-ff18-488f-982e-1ba9be77e312","Type":"ContainerStarted","Data":"ed4e0fd4fd7d5603c4143bd7eb30c848cec66b6641dba987bc690f60a19487df"}
Jul 20 15:38:39.361636 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.361250    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:39.361636 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.361298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9dhxp" event={"ID":"bccab366-ff18-488f-982e-1ba9be77e312","Type":"ContainerStarted","Data":"616b05efa5359ee9b0c4a6487c99e845300ec8cffcad6a89228051aa65c9ef13"}
Jul 20 15:38:39.400686 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.400636    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9dhxp" podStartSLOduration=251.616369055 podStartE2EDuration="4m13.40062088s" totalImagesPullingTime="1.784251825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:39.400223039 +0000 UTC m=+287.941950745" watchObservedRunningTime="2026-07-20 15:38:39.40062088 +0000 UTC m=+287.942348565"
Jul 20 15:38:39.414394 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.414343    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:39.985861 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:39.985713    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"]
Jul 20 15:38:40.367227 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:40.367128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"d20df455b4a26705b595379fbeb0d670ad9dea46d235094f7fc7769f74be9da1"}
Jul 20 15:38:40.367227 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:40.367213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"54d480acab5e370b19f6591dab9b14db8d993c19737d63908fe94be4b3bc836e"}
Jul 20 15:38:40.367685 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:40.367263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"458450aa66196b1a24832797bb992f5b481034cb676c8fa2e9c0abca35330df4"}
Jul 20 15:38:40.368250 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:40.368226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q" event={"ID":"42621ed7-6705-4db2-ab8f-35efc1aeb727","Type":"ContainerStarted","Data":"f55af2667ddcbbbcafe490c63951f7c7b0c86f0a130be9a1698f57ea6481346e"}
Jul 20 15:38:42.378005 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.377965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"b7e3969f631c19bf56312292196ec67dd98b8ea2ae6a7d54c527898db56fd227"}
Jul 20 15:38:42.378476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.378071    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:42.378476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.378120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"c5c964fb60e888fd47bb6a723dcdab6aad17d0a3a7b78fe01179bae011796bf1"}
Jul 20 15:38:42.378476 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.378159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" event={"ID":"2852294b-28f2-4cd4-a1e3-6c3c6ec3068f","Type":"ContainerStarted","Data":"5f36126b6972711f3d597e039b4672c5587602205e15e8914d783820cdc270a4"}
Jul 20 15:38:42.379370 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.379346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q" event={"ID":"42621ed7-6705-4db2-ab8f-35efc1aeb727","Type":"ContainerStarted","Data":"f9c4969375582e4231e8f24a8f671f21313be05f9b586b1c7dcc9f61f4649b3e"}
Jul 20 15:38:42.379543 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.379528    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:42.384280 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.384262    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q"
Jul 20 15:38:42.420306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.420262    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg" podStartSLOduration=1.921536702 podStartE2EDuration="5.420247764s" totalImagesPullingTime="3.498711062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:42.419961483 +0000 UTC m=+290.961689185" watchObservedRunningTime="2026-07-20 15:38:42.420247764 +0000 UTC m=+290.961975448"
Jul 20 15:38:42.440508 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:42.440472    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rs96q" podStartSLOduration=3.026373257 podStartE2EDuration="4.440459398s" totalImagesPullingTime="1.414086141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:42.439119336 +0000 UTC m=+290.980847031" watchObservedRunningTime="2026-07-20 15:38:42.440459398 +0000 UTC m=+290.982187132"
Jul 20 15:38:44.494325 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:38:44.494286    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hfwdl" podUID="386c94ce-047f-419e-bc49-db7d3da7f6a6"
Jul 20 15:38:48.389354 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:48.389325    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57c45b7df6-hq6zg"
Jul 20 15:38:49.370935 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:49.370900    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9dhxp"
Jul 20 15:38:49.946565 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:49.946530    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:38:52.375094 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:52.375071    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 15:38:58.493732 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:58.493698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:38:59.794812 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:59.794744    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dhxp_bccab366-ff18-488f-982e-1ba9be77e312/dns/0.log"
Jul 20 15:38:59.952569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:59.952543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:38:59.993002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:38:59.992977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dhxp_bccab366-ff18-488f-982e-1ba9be77e312/kube-rbac-proxy/0.log"
Jul 20 15:39:01.192377 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:01.192352    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxxsq_b1953acb-7e74-4ebd-a62c-fd91964d2f5c/dns-node-resolver/0.log"
Jul 20 15:39:02.195475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:02.195447    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzx4m_8be52aba-60eb-46d6-935a-cc9be9ff19f9/serve-healthcheck-canary/0.log"
Jul 20 15:39:14.966333 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:14.966274    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" containerName="registry" containerID="cri-o://29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846" gracePeriod=30
Jul 20 15:39:15.206238 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.206217    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:39:15.325230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325147    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325185    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325250    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lphkl\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325342    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration\") pod \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\" (UID: \"71a17f6c-b2c1-47f6-88d2-47d63ffc337a\") "
Jul 20 15:39:15.325812 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:15.325812 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325629    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-certificates\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.325812 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.325763    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:15.327726 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.327694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:15.327942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.327825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl" (OuterVolumeSpecName: "kube-api-access-lphkl") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "kube-api-access-lphkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:15.327942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.327900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:15.328062 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.327961    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:15.328062 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.328015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:15.336804 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.336727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "71a17f6c-b2c1-47f6-88d2-47d63ffc337a" (UID: "71a17f6c-b2c1-47f6-88d2-47d63ffc337a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:39:15.426968 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.426940    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-trusted-ca\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.426968 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.426968    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-installation-pull-secrets\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.427122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.426983    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-bound-sa-token\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.427122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.426995    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lphkl\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-kube-api-access-lphkl\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.427122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.427007    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-ca-trust-extracted\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.427122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.427020    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-image-registry-private-configuration\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.427122 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.427032    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71a17f6c-b2c1-47f6-88d2-47d63ffc337a-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:39:15.508923 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.508901    2558 generic.go:356] "Generic (PLEG): container finished" podID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" containerID="29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846" exitCode=0
Jul 20 15:39:15.509012 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.508942    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8"
Jul 20 15:39:15.509076 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.508943    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" event={"ID":"71a17f6c-b2c1-47f6-88d2-47d63ffc337a","Type":"ContainerDied","Data":"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"}
Jul 20 15:39:15.509133 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.509084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-579b8fb87-9nrx8" event={"ID":"71a17f6c-b2c1-47f6-88d2-47d63ffc337a","Type":"ContainerDied","Data":"5b4b1b299999dbed79b3fe4bc6408d4b3175174848c125131da2070ff7733857"}
Jul 20 15:39:15.509133 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.509120    2558 scope.go:117] "RemoveContainer" containerID="29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"
Jul 20 15:39:15.518939 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.518924    2558 scope.go:117] "RemoveContainer" containerID="29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"
Jul 20 15:39:15.519213 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:39:15.519193    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846\": container with ID starting with 29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846 not found: ID does not exist" containerID="29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"
Jul 20 15:39:15.519263 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.519220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846"} err="failed to get container status \"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846\": rpc error: code = NotFound desc = could not find container \"29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846\": container with ID starting with 29884f18bad615f48dc252fb8c8284399abbe64b2d27133c187fb9d1aa0e0846 not found: ID does not exist"
Jul 20 15:39:15.529813 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.529789    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:39:15.536861 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:15.536841    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-579b8fb87-9nrx8"]
Jul 20 15:39:16.501058 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:16.501021    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" path="/var/lib/kubelet/pods/71a17f6c-b2c1-47f6-88d2-47d63ffc337a/volumes"
Jul 20 15:39:20.527186 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:20.527147    2558 generic.go:356] "Generic (PLEG): container finished" podID="c59f9398-dda2-4c84-b87f-6fa776cf9673" containerID="b87fa5472371a3b66f458c360aa76af589835ae0b15f4753f2f51b45e54d480a" exitCode=0
Jul 20 15:39:20.527664 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:20.527225    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk" event={"ID":"c59f9398-dda2-4c84-b87f-6fa776cf9673","Type":"ContainerDied","Data":"b87fa5472371a3b66f458c360aa76af589835ae0b15f4753f2f51b45e54d480a"}
Jul 20 15:39:20.527664 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:20.527511    2558 scope.go:117] "RemoveContainer" containerID="b87fa5472371a3b66f458c360aa76af589835ae0b15f4753f2f51b45e54d480a"
Jul 20 15:39:21.532701 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:21.532666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dsnnk" event={"ID":"c59f9398-dda2-4c84-b87f-6fa776cf9673","Type":"ContainerStarted","Data":"33300787301e6a7dcf6c3176288dc49b336ba3ecf6ce77ac7679dfee68cf070d"}
Jul 20 15:39:25.546823 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:25.546783    2558 generic.go:356] "Generic (PLEG): container finished" podID="3479d0c3-482d-4d34-a112-af3628a4e741" containerID="dad3259fdb2c86e0d5e47f80288b633105d50b36be87a3744d099d284f6e4b09" exitCode=0
Jul 20 15:39:25.547284 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:25.546839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97" event={"ID":"3479d0c3-482d-4d34-a112-af3628a4e741","Type":"ContainerDied","Data":"dad3259fdb2c86e0d5e47f80288b633105d50b36be87a3744d099d284f6e4b09"}
Jul 20 15:39:25.547284 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:25.547125    2558 scope.go:117] "RemoveContainer" containerID="dad3259fdb2c86e0d5e47f80288b633105d50b36be87a3744d099d284f6e4b09"
Jul 20 15:39:26.552874 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:39:26.552839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gvt97" event={"ID":"3479d0c3-482d-4d34-a112-af3628a4e741","Type":"ContainerStarted","Data":"dd9fa3738df1756d571a81e059c1fcd524645144b586333a3cfb9d0d141331e1"}
Jul 20 15:40:06.310836 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.310801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:40:06.312998 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.312967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386c94ce-047f-419e-bc49-db7d3da7f6a6-metrics-certs\") pod \"network-metrics-daemon-hfwdl\" (UID: \"386c94ce-047f-419e-bc49-db7d3da7f6a6\") " pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:40:06.597112 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.597020    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbh6k\""
Jul 20 15:40:06.605023 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.605000    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hfwdl"
Jul 20 15:40:06.755914 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.755870    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hfwdl"]
Jul 20 15:40:06.758848 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:40:06.758818    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386c94ce_047f_419e_bc49_db7d3da7f6a6.slice/crio-e248ff3699f41146bedca457b9202883deb64fb53fa34ab7eaf6f3c6bbbac534 WatchSource:0}: Error finding container e248ff3699f41146bedca457b9202883deb64fb53fa34ab7eaf6f3c6bbbac534: Status 404 returned error can't find the container with id e248ff3699f41146bedca457b9202883deb64fb53fa34ab7eaf6f3c6bbbac534
Jul 20 15:40:06.760656 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:06.760640    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:40:07.701542 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:07.701504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfwdl" event={"ID":"386c94ce-047f-419e-bc49-db7d3da7f6a6","Type":"ContainerStarted","Data":"e248ff3699f41146bedca457b9202883deb64fb53fa34ab7eaf6f3c6bbbac534"}
Jul 20 15:40:08.706906 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:08.706863    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfwdl" event={"ID":"386c94ce-047f-419e-bc49-db7d3da7f6a6","Type":"ContainerStarted","Data":"aef05f41268966170d4e62b0dc43025fbd761a7535a379a2a84a0bb9243bbfdc"}
Jul 20 15:40:08.707303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:08.706922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hfwdl" event={"ID":"386c94ce-047f-419e-bc49-db7d3da7f6a6","Type":"ContainerStarted","Data":"e1cf2f7a9ca90a82e9fa078aa92845c6e6206b0cc662d2d8b7256ab205475ca1"}
Jul 20 15:40:08.725039 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:40:08.724990    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hfwdl" podStartSLOduration=375.582991541 podStartE2EDuration="6m16.724975349s" totalImagesPullingTime="1.141983808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:40:08.723926715 +0000 UTC m=+377.265654398" watchObservedRunningTime="2026-07-20 15:40:08.724975349 +0000 UTC m=+377.266703033"
Jul 20 15:42:54.396689 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.396601    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:42:54.397182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.396999    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" containerName="registry"
Jul 20 15:42:54.397182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.397013    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" containerName="registry"
Jul 20 15:42:54.397182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.397068    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a17f6c-b2c1-47f6-88d2-47d63ffc337a" containerName="registry"
Jul 20 15:42:54.399787 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.399771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:54.402012 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.401985    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-f4jrt\""
Jul 20 15:42:54.402121 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.402020    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 20 15:42:54.402592 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.402574    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 20 15:42:54.413984 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.413961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:42:54.535084 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.535050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mt7c\" (UniqueName: \"kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c\") pod \"feast-operator-controller-manager-5dc7f95ccd-sbwjl\" (UID: \"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa\") " pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:54.635826 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.635786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mt7c\" (UniqueName: \"kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c\") pod \"feast-operator-controller-manager-5dc7f95ccd-sbwjl\" (UID: \"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa\") " pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:54.644451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.644416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mt7c\" (UniqueName: \"kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c\") pod \"feast-operator-controller-manager-5dc7f95ccd-sbwjl\" (UID: \"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa\") " pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:54.709208 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.709136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:54.833011 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:54.832825    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:42:54.835761 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:42:54.835720    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7f47ab_2db8_46f6_835b_e7d5f560a8aa.slice/crio-763cb57e2ca6704c8a34fae1e258c83c6fdd5a226bb3945dfb445087bb0728eb WatchSource:0}: Error finding container 763cb57e2ca6704c8a34fae1e258c83c6fdd5a226bb3945dfb445087bb0728eb: Status 404 returned error can't find the container with id 763cb57e2ca6704c8a34fae1e258c83c6fdd5a226bb3945dfb445087bb0728eb
Jul 20 15:42:55.322276 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:55.322232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" event={"ID":"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa","Type":"ContainerStarted","Data":"763cb57e2ca6704c8a34fae1e258c83c6fdd5a226bb3945dfb445087bb0728eb"}
Jul 20 15:42:57.331824 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:57.331785    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" event={"ID":"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa","Type":"ContainerStarted","Data":"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"}
Jul 20 15:42:57.332254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:57.331910    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:42:57.346852 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:42:57.346808    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" podStartSLOduration=0.927315478 podStartE2EDuration="3.346792727s" totalImagesPullingTime="2.419477249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:42:57.34563676 +0000 UTC m=+545.887364462" watchObservedRunningTime="2026-07-20 15:42:57.346792727 +0000 UTC m=+545.888520411"
Jul 20 15:43:08.337635 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:08.337606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:43:31.583674 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.583634    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:43:31.592273 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.592246    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.594987 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.594956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 20 15:43:31.594987 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.594978    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 15:43:31.595175 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595092    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-t8dqk\""
Jul 20 15:43:31.595246 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595229    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:43:31.595307 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 15:43:31.595363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595345    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:43:31.595455 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 15:43:31.595564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.595507    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 15:43:31.606040 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.606019    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:43:31.702363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.702363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.702591 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7qm\" (UniqueName: \"kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.702591 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.702591 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.702591 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.702507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.803786 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.803742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.803786 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.803784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804017 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.803809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804017 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:43:31.803925    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 15:43:31.804017 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.803926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804017 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:43:31.804000    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls podName:d03b56ce-36c4-4946-979a-b528eeacebb0 nodeName:}" failed. No retries permitted until 2026-07-20 15:43:32.303977816 +0000 UTC m=+580.845705482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls") pod "feast-simple-feast-setup-686d5c5b94-qck2r" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 15:43:31.804230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.804057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7qm\" (UniqueName: \"kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.804121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.804190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.804230 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:43:31.804226    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:43:31.804427 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:43:31.804295    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls podName:d03b56ce-36c4-4946-979a-b528eeacebb0 nodeName:}" failed. No retries permitted until 2026-07-20 15:43:32.304278205 +0000 UTC m=+580.846005866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls") pod "feast-simple-feast-setup-686d5c5b94-qck2r" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:43:31.806413 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.806381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.806648 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.806632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:31.816973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:31.816952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7qm\" (UniqueName: \"kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.307787 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.307735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.307943 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.307808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.310268 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.310227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.310390 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.310367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-qck2r\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.508851 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.508816    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:43:32.643262 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:32.643237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:43:32.644947 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:43:32.644922    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd03b56ce_36c4_4946_979a_b528eeacebb0.slice/crio-309f096fb35407af8f946b2bf388cc71602b5864a668b66807214beb9b31e8d2 WatchSource:0}: Error finding container 309f096fb35407af8f946b2bf388cc71602b5864a668b66807214beb9b31e8d2: Status 404 returned error can't find the container with id 309f096fb35407af8f946b2bf388cc71602b5864a668b66807214beb9b31e8d2
Jul 20 15:43:33.466837 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:43:33.466791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"309f096fb35407af8f946b2bf388cc71602b5864a668b66807214beb9b31e8d2"}
Jul 20 15:44:01.587188 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:01.587146    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"}
Jul 20 15:44:06.606312 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:06.606273    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4" exitCode=0
Jul 20 15:44:06.606734 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:06.606348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"}
Jul 20 15:44:07.611918 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:07.611885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"}
Jul 20 15:44:12.636320 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:12.636289    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1" exitCode=0
Jul 20 15:44:12.636709 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:12.636370    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"}
Jul 20 15:44:12.645959 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:12.645940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 20 15:44:13.646243 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:13.646201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"}
Jul 20 15:44:13.646736 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:13.646287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"}
Jul 20 15:44:13.646736 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:13.646313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"}
Jul 20 15:44:13.646736 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:13.646332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerStarted","Data":"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"}
Jul 20 15:44:14.509643 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.509603    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:14.509870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.509664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:14.509870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.509686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:14.509870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.509703    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:14.512019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.511849    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
Jul 20 15:44:14.512019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.511914    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
Jul 20 15:44:14.512019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.511932    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
Jul 20 15:44:14.512279 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:14.512043    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
Jul 20 15:44:17.509164 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:17.509120    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
Jul 20 15:44:17.509794 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:17.509168    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
Jul 20 15:44:17.509942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:17.509159    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
Jul 20 15:44:17.509942 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:17.509185    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
Jul 20 15:44:20.510679 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.510649    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.510801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511020    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511347 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511326    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511473 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511473 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511374    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511707 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511685    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511828 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511779    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.511874 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.511856    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.515529 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.515514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.543602 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.543545    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podStartSLOduration=21.178894333 podStartE2EDuration="49.543529836s" totalImagesPullingTime="28.364635503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:44:13.685960033 +0000 UTC m=+622.227687782" watchObservedRunningTime="2026-07-20 15:44:20.543529836 +0000 UTC m=+629.085257519"
Jul 20 15:44:20.687043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.687003    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:44:20.690247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:44:20.690229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:45:23.062182 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.062144    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:45:23.062768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.062569    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry" containerID="cri-o://b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16" gracePeriod=30
Jul 20 15:45:23.062768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.062614    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline" containerID="cri-o://224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d" gracePeriod=30
Jul 20 15:45:23.062768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.062619    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" containerID="cri-o://7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18" gracePeriod=30
Jul 20 15:45:23.062768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.062648    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" containerID="cri-o://217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82" gracePeriod=30
Jul 20 15:45:23.390957 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.390920    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:45:23.395343 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.395320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.397936 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.397905    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r9wrx\""
Jul 20 15:45:23.410863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.410831    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:45:23.474177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp9zr\" (UniqueName: \"kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.474177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.474437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.474437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.474437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.474437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.474354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575699 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575866 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp9zr\" (UniqueName: \"kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575866 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.575973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.575915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.576111 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:23.575914    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:45:23.576246 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:23.576227    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls podName:1098a370-29c7-4d30-86c4-6353a7f1c79c nodeName:}" failed. No retries permitted until 2026-07-20 15:45:24.076202572 +0000 UTC m=+692.617930244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls") pod "feast-simple-feast-setup-686d5c5b94-j7jjp" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c") : secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:45:23.576496 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.576414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.578647 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.578432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.578647 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.578609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.578947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.578922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.584609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.584581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp9zr\" (UniqueName: \"kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:23.930661 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.930630    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82" exitCode=0
Jul 20 15:45:23.930661 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.930655    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18" exitCode=0
Jul 20 15:45:23.930873 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.930707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"}
Jul 20 15:45:23.930873 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:23.930759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"}
Jul 20 15:45:24.079430 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.079357    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:24.081887 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.081853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") pod \"feast-simple-feast-setup-686d5c5b94-j7jjp\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") " pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:24.306976 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.306934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:24.447569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.447535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:45:24.448924 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:45:24.448897    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1098a370_29c7_4d30_86c4_6353a7f1c79c.slice/crio-c8faf2f42d6ff9664658000ec36be07da7d8f30c1d41a35ac2e9d482f9088a7d WatchSource:0}: Error finding container c8faf2f42d6ff9664658000ec36be07da7d8f30c1d41a35ac2e9d482f9088a7d: Status 404 returned error can't find the container with id c8faf2f42d6ff9664658000ec36be07da7d8f30c1d41a35ac2e9d482f9088a7d
Jul 20 15:45:24.936503 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.936463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"0cc7f3cb341c3807534dee2227134befa87dd37a3a73c763e971a19d984ccc9d"}
Jul 20 15:45:24.936503 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:24.936509    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"c8faf2f42d6ff9664658000ec36be07da7d8f30c1d41a35ac2e9d482f9088a7d"}
Jul 20 15:45:29.959356 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:29.959322    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="0cc7f3cb341c3807534dee2227134befa87dd37a3a73c763e971a19d984ccc9d" exitCode=0
Jul 20 15:45:29.959744 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:29.959379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"0cc7f3cb341c3807534dee2227134befa87dd37a3a73c763e971a19d984ccc9d"}
Jul 20 15:45:30.512303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:30.512254    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
Jul 20 15:45:30.687987 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:30.687947    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
Jul 20 15:45:30.964656 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:30.964619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"be99d41c3b9906e38183ce655e9977e1099960b8b95dd3a57c9a32a6b00f78cf"}
Jul 20 15:45:35.985633 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:35.985596    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="be99d41c3b9906e38183ce655e9977e1099960b8b95dd3a57c9a32a6b00f78cf" exitCode=0
Jul 20 15:45:35.986018 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:35.985646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"be99d41c3b9906e38183ce655e9977e1099960b8b95dd3a57c9a32a6b00f78cf"}
Jul 20 15:45:36.995504 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:36.995462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"a0075ba01be4de38c18424819f8fc3e378207f3d788a27d495483fc99d4de5cb"}
Jul 20 15:45:36.996019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:36.995528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"f8ff2b8596a4f63edde0c55f0a1d9d73ac3e58f540e0c57afee1c7f171c08092"}
Jul 20 15:45:36.996019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:36.995553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"8b49c65b0677f3022a76f080977c67004cc79e721190441abfc62d0cbb611f66"}
Jul 20 15:45:36.996019 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:36.995571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerStarted","Data":"0f57ec1998cad90dbe7d21de04ece36b17b9164c01b621896996c21e6ddad5f9"}
Jul 20 15:45:37.025585 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:37.025519    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podStartSLOduration=14.025498204 podStartE2EDuration="14.025498204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:45:37.023531039 +0000 UTC m=+705.565258748" watchObservedRunningTime="2026-07-20 15:45:37.025498204 +0000 UTC m=+705.567225890"
Jul 20 15:45:39.307833 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.307793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:39.308394 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.308371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:39.308540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.308402    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:39.308540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.308424    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:39.309989 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.309950    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Jul 20 15:45:39.310109 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.309981    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Jul 20 15:45:39.310109 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.310017    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Jul 20 15:45:39.310109 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:39.309964    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 20 15:45:40.512401 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:40.512352    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
Jul 20 15:45:40.687637 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:40.687578    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
Jul 20 15:45:42.309020 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.308986    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.309494 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.309177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.309494 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.309331    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.309837 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.309809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.310020 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.310007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.310117 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.310099    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.310217 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.310171    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.310257 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.310234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.310298 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.310289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:42.314074 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:42.314056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:43.027873 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:43.027841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:43.031000 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:43.030973    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:45:50.512128 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:50.512033    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
Jul 20 15:45:50.512570 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:50.512176    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:45:50.687513 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:50.687471    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
Jul 20 15:45:50.687665 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:50.687602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:45:53.710245 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.710220    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:45:53.829931 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.829831    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.829931 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.829886    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj7qm\" (UniqueName: \"kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.829931 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.829925    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.830217 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.829951    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.830217 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.829976    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.830217 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.830016    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") pod \"d03b56ce-36c4-4946-979a-b528eeacebb0\" (UID: \"d03b56ce-36c4-4946-979a-b528eeacebb0\") "
Jul 20 15:45:53.830540 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.830512    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data" (OuterVolumeSpecName: "feast-data") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:45:53.832261 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.832233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:53.832529 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.832505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:53.832621 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.832540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:53.832621 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.832591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm" (OuterVolumeSpecName: "kube-api-access-rj7qm") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "kube-api-access-rj7qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:45:53.832621 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.832601    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls" (OuterVolumeSpecName: "online-tls") pod "d03b56ce-36c4-4946-979a-b528eeacebb0" (UID: "d03b56ce-36c4-4946-979a-b528eeacebb0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:53.931303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931264    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:53.931303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931297    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:53.931303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931309    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:53.931599 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931322    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d03b56ce-36c4-4946-979a-b528eeacebb0-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:53.931599 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931334    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj7qm\" (UniqueName: \"kubernetes.io/projected/d03b56ce-36c4-4946-979a-b528eeacebb0-kube-api-access-rj7qm\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:53.931599 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:53.931347    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d03b56ce-36c4-4946-979a-b528eeacebb0-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:45:54.072350 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072314    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d" exitCode=137
Jul 20 15:45:54.072350 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072348    2558 generic.go:356] "Generic (PLEG): container finished" podID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerID="b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16" exitCode=137
Jul 20 15:45:54.072531 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"}
Jul 20 15:45:54.072531 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072382    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"
Jul 20 15:45:54.072531 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"}
Jul 20 15:45:54.072531 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r" event={"ID":"d03b56ce-36c4-4946-979a-b528eeacebb0","Type":"ContainerDied","Data":"309f096fb35407af8f946b2bf388cc71602b5864a668b66807214beb9b31e8d2"}
Jul 20 15:45:54.072531 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.072464    2558 scope.go:117] "RemoveContainer" containerID="217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"
Jul 20 15:45:54.082134 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.082112    2558 scope.go:117] "RemoveContainer" containerID="224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"
Jul 20 15:45:54.089835 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.089814    2558 scope.go:117] "RemoveContainer" containerID="7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"
Jul 20 15:45:54.096068 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.096041    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:45:54.097999 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.097979    2558 scope.go:117] "RemoveContainer" containerID="b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"
Jul 20 15:45:54.102440 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.102418    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-qck2r"]
Jul 20 15:45:54.106724 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.106706    2558 scope.go:117] "RemoveContainer" containerID="4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"
Jul 20 15:45:54.113929 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.113910    2558 scope.go:117] "RemoveContainer" containerID="b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"
Jul 20 15:45:54.120685 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.120666    2558 scope.go:117] "RemoveContainer" containerID="217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"
Jul 20 15:45:54.120944 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.120926    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82\": container with ID starting with 217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82 not found: ID does not exist" containerID="217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"
Jul 20 15:45:54.120995 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.120954    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"} err="failed to get container status \"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82\": rpc error: code = NotFound desc = could not find container \"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82\": container with ID starting with 217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82 not found: ID does not exist"
Jul 20 15:45:54.120995 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.120972    2558 scope.go:117] "RemoveContainer" containerID="224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"
Jul 20 15:45:54.121190 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.121176    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d\": container with ID starting with 224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d not found: ID does not exist" containerID="224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"
Jul 20 15:45:54.121230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121193    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"} err="failed to get container status \"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d\": rpc error: code = NotFound desc = could not find container \"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d\": container with ID starting with 224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d not found: ID does not exist"
Jul 20 15:45:54.121230 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121205    2558 scope.go:117] "RemoveContainer" containerID="7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"
Jul 20 15:45:54.121411 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.121392    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18\": container with ID starting with 7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18 not found: ID does not exist" containerID="7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"
Jul 20 15:45:54.121454 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121419    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"} err="failed to get container status \"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18\": rpc error: code = NotFound desc = could not find container \"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18\": container with ID starting with 7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18 not found: ID does not exist"
Jul 20 15:45:54.121454 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121437    2558 scope.go:117] "RemoveContainer" containerID="b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"
Jul 20 15:45:54.121629 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.121614    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16\": container with ID starting with b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16 not found: ID does not exist" containerID="b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"
Jul 20 15:45:54.121671 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121633    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"} err="failed to get container status \"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16\": rpc error: code = NotFound desc = could not find container \"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16\": container with ID starting with b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16 not found: ID does not exist"
Jul 20 15:45:54.121671 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121645    2558 scope.go:117] "RemoveContainer" containerID="4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"
Jul 20 15:45:54.121871 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.121850    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1\": container with ID starting with 4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1 not found: ID does not exist" containerID="4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"
Jul 20 15:45:54.121925 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121879    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"} err="failed to get container status \"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1\": rpc error: code = NotFound desc = could not find container \"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1\": container with ID starting with 4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1 not found: ID does not exist"
Jul 20 15:45:54.121925 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.121894    2558 scope.go:117] "RemoveContainer" containerID="b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"
Jul 20 15:45:54.122094 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:45:54.122078    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4\": container with ID starting with b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4 not found: ID does not exist" containerID="b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"
Jul 20 15:45:54.122141 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122097    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"} err="failed to get container status \"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4\": rpc error: code = NotFound desc = could not find container \"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4\": container with ID starting with b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4 not found: ID does not exist"
Jul 20 15:45:54.122141 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122109    2558 scope.go:117] "RemoveContainer" containerID="217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"
Jul 20 15:45:54.122271 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122253    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82"} err="failed to get container status \"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82\": rpc error: code = NotFound desc = could not find container \"217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82\": container with ID starting with 217c866ac2c117b3cf4154144577795c1cc33c159aa437e49588a642739eea82 not found: ID does not exist"
Jul 20 15:45:54.122320 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122271    2558 scope.go:117] "RemoveContainer" containerID="224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"
Jul 20 15:45:54.122518 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122499    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d"} err="failed to get container status \"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d\": rpc error: code = NotFound desc = could not find container \"224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d\": container with ID starting with 224eb6254ac81aeaada78d78b5175c2d91171210e6eb0bb329e8204a4f357f3d not found: ID does not exist"
Jul 20 15:45:54.122590 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122519    2558 scope.go:117] "RemoveContainer" containerID="7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"
Jul 20 15:45:54.122738 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122723    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18"} err="failed to get container status \"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18\": rpc error: code = NotFound desc = could not find container \"7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18\": container with ID starting with 7e587ba5f5f236ae3dcd3fb2fc4916a0b1aaa2e50f4787b85c18eb3dca8f3f18 not found: ID does not exist"
Jul 20 15:45:54.122814 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122738    2558 scope.go:117] "RemoveContainer" containerID="b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"
Jul 20 15:45:54.122968 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122951    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16"} err="failed to get container status \"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16\": rpc error: code = NotFound desc = could not find container \"b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16\": container with ID starting with b8678e9622d6e56bd3c5474549de1f8f5629b3beee1f7c81e6c090f1f6376f16 not found: ID does not exist"
Jul 20 15:45:54.123010 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.122968    2558 scope.go:117] "RemoveContainer" containerID="4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"
Jul 20 15:45:54.123156 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.123139    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1"} err="failed to get container status \"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1\": rpc error: code = NotFound desc = could not find container \"4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1\": container with ID starting with 4dc660b2627defe289b3ca0e728d45053d46d9ba821fb873727e67c3fc5774a1 not found: ID does not exist"
Jul 20 15:45:54.123198 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.123156    2558 scope.go:117] "RemoveContainer" containerID="b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"
Jul 20 15:45:54.123346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.123328    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4"} err="failed to get container status \"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4\": rpc error: code = NotFound desc = could not find container \"b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4\": container with ID starting with b7205613268a2b573a5fb2c10dfa99ac68d056ece6895ac2199c9ec061f318e4 not found: ID does not exist"
Jul 20 15:45:54.498844 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:45:54.498817    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" path="/var/lib/kubelet/pods/d03b56ce-36c4-4946-979a-b528eeacebb0/volumes"
Jul 20 15:46:45.118564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118529    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118862    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118874    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118883    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="feast-apply"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118889    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="feast-apply"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118896    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="feast-init"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118902    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="feast-init"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118912    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118916    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118923    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118928    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118936    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118941    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118989    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="offline"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.118996    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="ui"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.119003    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="registry"
Jul 20 15:46:45.119185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.119011    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d03b56ce-36c4-4946-979a-b528eeacebb0" containerName="online"
Jul 20 15:46:45.122444 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.122427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.126337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126312    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 15:46:45.126479 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126456    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 15:46:45.126549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 15:46:45.126549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126523    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 15:46:45.126653 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126606    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 15:46:45.126834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126809    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:46:45.126834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126820    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 20 15:46:45.126834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.126807    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-rvh8m\""
Jul 20 15:46:45.140721 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.140694    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:46:45.212867 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.212831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.213037 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.212884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.213037 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.212909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcjk\" (UniqueName: \"kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.213037 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.212960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.213037 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.213011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.213037 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.213031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313434 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313609 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcjk\" (UniqueName: \"kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.313901 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:46:45.313742    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 20 15:46:45.313901 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:46:45.313844    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls podName:e0a74aa3-895e-4a8b-badf-12ab944c7e4d nodeName:}" failed. No retries permitted until 2026-07-20 15:46:45.813820839 +0000 UTC m=+774.355548511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls") pod "feast-simple-feast-remote-setup-6448cf946-9np6q" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 20 15:46:45.313997 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.313920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.314278 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.314254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.316281 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.316258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.316437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.316245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.324160 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.324138    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcjk\" (UniqueName: \"kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.817864 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.817821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:45.820275 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:45.820245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") pod \"feast-simple-feast-remote-setup-6448cf946-9np6q\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:46.032365 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:46.032315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:46:46.163238 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:46.163213    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:46:46.164891 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:46:46.164865    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0a74aa3_895e_4a8b_badf_12ab944c7e4d.slice/crio-d2308a14161c6af41e874465509b2bda96460bdfe4c53e45604d03d6eb11a033 WatchSource:0}: Error finding container d2308a14161c6af41e874465509b2bda96460bdfe4c53e45604d03d6eb11a033: Status 404 returned error can't find the container with id d2308a14161c6af41e874465509b2bda96460bdfe4c53e45604d03d6eb11a033
Jul 20 15:46:46.274368 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:46.274325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"49b0b2e4aa312f40e19a7f825e57c86eb28faeafe430c9f4d936f27fbd10963d"}
Jul 20 15:46:46.274550 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:46.274382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"d2308a14161c6af41e874465509b2bda96460bdfe4c53e45604d03d6eb11a033"}
Jul 20 15:46:51.297331 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:51.297298    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerID="49b0b2e4aa312f40e19a7f825e57c86eb28faeafe430c9f4d936f27fbd10963d" exitCode=0
Jul 20 15:46:51.297737 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:51.297359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"49b0b2e4aa312f40e19a7f825e57c86eb28faeafe430c9f4d936f27fbd10963d"}
Jul 20 15:46:52.303058 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:52.303017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"9c8f69b13d1a915e57269556c3c5175ca04c02397701240534d1bae59c4826b0"}
Jul 20 15:46:57.325489 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:57.325453    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerID="9c8f69b13d1a915e57269556c3c5175ca04c02397701240534d1bae59c4826b0" exitCode=0
Jul 20 15:46:57.325889 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:57.325527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"9c8f69b13d1a915e57269556c3c5175ca04c02397701240534d1bae59c4826b0"}
Jul 20 15:46:57.329270 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:57.329251    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 20 15:46:58.334831 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:58.334789    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"be4a5257042e4ba95145bb8527bfe7df3759d3b10e0ab37b0de88b6691a3a848"}
Jul 20 15:46:58.335329 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:58.334850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"cba8d14b8530f418f682e72d3a5d37c89f3aee768a5e9db0cc0c2fe4982db8d1"}
Jul 20 15:46:58.335329 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:58.334868    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerStarted","Data":"f80eaf4460ea5ad3953596b730ef7fb2326e62b30c1300bed8631078f1bafa77"}
Jul 20 15:46:58.361149 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:46:58.361081    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podStartSLOduration=13.361065598 podStartE2EDuration="13.361065598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:46:58.359695668 +0000 UTC m=+786.901423380" watchObservedRunningTime="2026-07-20 15:46:58.361065598 +0000 UTC m=+786.902793281"
Jul 20 15:47:01.032765 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.032709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:01.033346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.033323    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:01.033503 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.033352    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:01.034513 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.034474    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 20 15:47:01.034624 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.034492    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
Jul 20 15:47:01.034624 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:01.034551    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Jul 20 15:47:04.033945 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.033916    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.034421 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.034035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.034492 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.034437    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.034492 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.034472    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.034893 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.034870    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.034989 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.034935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.040369 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.040349    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.362924 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.362891    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:47:04.367853 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:47:04.367828    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:48:06.397816 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.397778    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:48:06.398360 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.398013    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online" containerID="cri-o://f80eaf4460ea5ad3953596b730ef7fb2326e62b30c1300bed8631078f1bafa77" gracePeriod=30
Jul 20 15:48:06.398360 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.398080    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui" containerID="cri-o://be4a5257042e4ba95145bb8527bfe7df3759d3b10e0ab37b0de88b6691a3a848" gracePeriod=30
Jul 20 15:48:06.398360 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.398100    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="offline" containerID="cri-o://cba8d14b8530f418f682e72d3a5d37c89f3aee768a5e9db0cc0c2fe4982db8d1" gracePeriod=30
Jul 20 15:48:06.520289 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.520256    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:48:06.520557 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.520528    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="registry" containerID="cri-o://0f57ec1998cad90dbe7d21de04ece36b17b9164c01b621896996c21e6ddad5f9" gracePeriod=30
Jul 20 15:48:06.521304 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.520604    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui" containerID="cri-o://a0075ba01be4de38c18424819f8fc3e378207f3d788a27d495483fc99d4de5cb" gracePeriod=30
Jul 20 15:48:06.521304 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.520600    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="offline" containerID="cri-o://f8ff2b8596a4f63edde0c55f0a1d9d73ac3e58f540e0c57afee1c7f171c08092" gracePeriod=30
Jul 20 15:48:06.521304 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:06.520632    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online" containerID="cri-o://8b49c65b0677f3022a76f080977c67004cc79e721190441abfc62d0cbb611f66" gracePeriod=30
Jul 20 15:48:07.609657 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.609570    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="a0075ba01be4de38c18424819f8fc3e378207f3d788a27d495483fc99d4de5cb" exitCode=0
Jul 20 15:48:07.609657 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.609599    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="8b49c65b0677f3022a76f080977c67004cc79e721190441abfc62d0cbb611f66" exitCode=0
Jul 20 15:48:07.609657 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.609638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"a0075ba01be4de38c18424819f8fc3e378207f3d788a27d495483fc99d4de5cb"}
Jul 20 15:48:07.610136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.609680    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"8b49c65b0677f3022a76f080977c67004cc79e721190441abfc62d0cbb611f66"}
Jul 20 15:48:07.612201 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.612180    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerID="be4a5257042e4ba95145bb8527bfe7df3759d3b10e0ab37b0de88b6691a3a848" exitCode=0
Jul 20 15:48:07.612201 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.612198    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerID="f80eaf4460ea5ad3953596b730ef7fb2326e62b30c1300bed8631078f1bafa77" exitCode=0
Jul 20 15:48:07.612324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.612250    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"be4a5257042e4ba95145bb8527bfe7df3759d3b10e0ab37b0de88b6691a3a848"}
Jul 20 15:48:07.612324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:07.612283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"f80eaf4460ea5ad3953596b730ef7fb2326e62b30c1300bed8631078f1bafa77"}
Jul 20 15:48:12.310625 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:12.310572    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 20 15:48:13.028812 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:13.028772    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Jul 20 15:48:14.034958 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:14.034916    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 20 15:48:14.363574 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:14.363484    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Jul 20 15:48:22.310175 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:22.310125    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 20 15:48:23.028638 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:23.028597    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Jul 20 15:48:24.034796 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:24.034728    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 20 15:48:24.364031 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:24.363934    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Jul 20 15:48:32.310217 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:32.310169    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
Jul 20 15:48:32.310768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:32.310362    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:48:33.028735 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:33.028695    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Jul 20 15:48:33.028926 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:33.028851    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:48:34.035466 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:34.035423    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 20 15:48:34.035916 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:34.035571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:48:34.363465 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:34.363378    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Jul 20 15:48:34.363641 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:34.363485    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:48:36.729594 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.729504    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="f8ff2b8596a4f63edde0c55f0a1d9d73ac3e58f540e0c57afee1c7f171c08092" exitCode=137
Jul 20 15:48:36.729594 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.729531    2558 generic.go:356] "Generic (PLEG): container finished" podID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerID="0f57ec1998cad90dbe7d21de04ece36b17b9164c01b621896996c21e6ddad5f9" exitCode=137
Jul 20 15:48:36.729594 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.729572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"f8ff2b8596a4f63edde0c55f0a1d9d73ac3e58f540e0c57afee1c7f171c08092"}
Jul 20 15:48:36.730160 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.729622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"0f57ec1998cad90dbe7d21de04ece36b17b9164c01b621896996c21e6ddad5f9"}
Jul 20 15:48:36.732529 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.732506    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerID="cba8d14b8530f418f682e72d3a5d37c89f3aee768a5e9db0cc0c2fe4982db8d1" exitCode=137
Jul 20 15:48:36.732643 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:36.732544    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"cba8d14b8530f418f682e72d3a5d37c89f3aee768a5e9db0cc0c2fe4982db8d1"}
Jul 20 15:48:37.054006 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.053982    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:48:37.101224 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmcjk\" (UniqueName: \"kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101292    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101325    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101538 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101361    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101538 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls\") pod \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\" (UID: \"e0a74aa3-895e-4a8b-badf-12ab944c7e4d\") "
Jul 20 15:48:37.101724 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101692    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:48:37.101817 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.101791    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data" (OuterVolumeSpecName: "feast-data") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:48:37.104612 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.104583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk" (OuterVolumeSpecName: "kube-api-access-dmcjk") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "kube-api-access-dmcjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:48:37.104612 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.104592    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.104828 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.104682    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls" (OuterVolumeSpecName: "online-tls") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.104906 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.104885    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e0a74aa3-895e-4a8b-badf-12ab944c7e4d" (UID: "e0a74aa3-895e-4a8b-badf-12ab944c7e4d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.168654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.168620    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:48:37.202509 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202480    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202667 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202517    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp9zr\" (UniqueName: \"kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202667 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202583    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202667 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202602    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202667 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202660    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202896 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202677    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls\") pod \"1098a370-29c7-4d30-86c4-6353a7f1c79c\" (UID: \"1098a370-29c7-4d30-86c4-6353a7f1c79c\") "
Jul 20 15:48:37.202947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202908    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.202947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202927    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.202947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202943    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmcjk\" (UniqueName: \"kubernetes.io/projected/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-kube-api-access-dmcjk\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.203093 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202957    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.203093 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202971    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.203093 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.202983    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e0a74aa3-895e-4a8b-badf-12ab944c7e4d-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.203266 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.203098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data" (OuterVolumeSpecName: "feast-data") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:48:37.205422 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.205390    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr" (OuterVolumeSpecName: "kube-api-access-mp9zr") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "kube-api-access-mp9zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:48:37.205422 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.205405    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.205422 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.205384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls" (OuterVolumeSpecName: "online-tls") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.205604 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.205545    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.205604 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.205599    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1098a370-29c7-4d30-86c4-6353a7f1c79c" (UID: "1098a370-29c7-4d30-86c4-6353a7f1c79c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303294    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1098a370-29c7-4d30-86c4-6353a7f1c79c-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303340    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp9zr\" (UniqueName: \"kubernetes.io/projected/1098a370-29c7-4d30-86c4-6353a7f1c79c-kube-api-access-mp9zr\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303350    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303357    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303365    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.303395 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.303373    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1098a370-29c7-4d30-86c4-6353a7f1c79c-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:48:37.738617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.738581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp" event={"ID":"1098a370-29c7-4d30-86c4-6353a7f1c79c","Type":"ContainerDied","Data":"c8faf2f42d6ff9664658000ec36be07da7d8f30c1d41a35ac2e9d482f9088a7d"}
Jul 20 15:48:37.738617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.738615    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"
Jul 20 15:48:37.739177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.738637    2558 scope.go:117] "RemoveContainer" containerID="a0075ba01be4de38c18424819f8fc3e378207f3d788a27d495483fc99d4de5cb"
Jul 20 15:48:37.741294 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.741275    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"
Jul 20 15:48:37.741294 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.741288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q" event={"ID":"e0a74aa3-895e-4a8b-badf-12ab944c7e4d","Type":"ContainerDied","Data":"d2308a14161c6af41e874465509b2bda96460bdfe4c53e45604d03d6eb11a033"}
Jul 20 15:48:37.750091 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.750076    2558 scope.go:117] "RemoveContainer" containerID="f8ff2b8596a4f63edde0c55f0a1d9d73ac3e58f540e0c57afee1c7f171c08092"
Jul 20 15:48:37.764943 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.764922    2558 scope.go:117] "RemoveContainer" containerID="8b49c65b0677f3022a76f080977c67004cc79e721190441abfc62d0cbb611f66"
Jul 20 15:48:37.773689 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.773672    2558 scope.go:117] "RemoveContainer" containerID="0f57ec1998cad90dbe7d21de04ece36b17b9164c01b621896996c21e6ddad5f9"
Jul 20 15:48:37.781875 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.781839    2558 scope.go:117] "RemoveContainer" containerID="be99d41c3b9906e38183ce655e9977e1099960b8b95dd3a57c9a32a6b00f78cf"
Jul 20 15:48:37.782186 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.782166    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:48:37.787839 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.787818    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6448cf946-9np6q"]
Jul 20 15:48:37.790944 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.790926    2558 scope.go:117] "RemoveContainer" containerID="0cc7f3cb341c3807534dee2227134befa87dd37a3a73c763e971a19d984ccc9d"
Jul 20 15:48:37.797713 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.797697    2558 scope.go:117] "RemoveContainer" containerID="be4a5257042e4ba95145bb8527bfe7df3759d3b10e0ab37b0de88b6691a3a848"
Jul 20 15:48:37.800460 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.800440    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:48:37.804114 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.804094    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-686d5c5b94-j7jjp"]
Jul 20 15:48:37.806665 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.806648    2558 scope.go:117] "RemoveContainer" containerID="cba8d14b8530f418f682e72d3a5d37c89f3aee768a5e9db0cc0c2fe4982db8d1"
Jul 20 15:48:37.813851 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.813832    2558 scope.go:117] "RemoveContainer" containerID="f80eaf4460ea5ad3953596b730ef7fb2326e62b30c1300bed8631078f1bafa77"
Jul 20 15:48:37.821830 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.821815    2558 scope.go:117] "RemoveContainer" containerID="9c8f69b13d1a915e57269556c3c5175ca04c02397701240534d1bae59c4826b0"
Jul 20 15:48:37.831028 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:37.831011    2558 scope.go:117] "RemoveContainer" containerID="49b0b2e4aa312f40e19a7f825e57c86eb28faeafe430c9f4d936f27fbd10963d"
Jul 20 15:48:38.498080 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:38.498046    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" path="/var/lib/kubelet/pods/1098a370-29c7-4d30-86c4-6353a7f1c79c/volumes"
Jul 20 15:48:38.498765 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:38.498731    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" path="/var/lib/kubelet/pods/e0a74aa3-895e-4a8b-badf-12ab944c7e4d/volumes"
Jul 20 15:48:39.777092 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777062    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777337    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777347    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777355    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777362    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777371    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="feast-apply"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777377    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="feast-apply"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777386    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="registry"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777391    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="registry"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777399    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="feast-init"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777404    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="feast-init"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777411    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="offline"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777416    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="offline"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777422    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777428    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777435    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="feast-init"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777439    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="feast-init"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777447    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777452    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777460    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="feast-apply"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777466    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="feast-apply"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777472    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="offline"
Jul 20 15:48:39.777495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777477    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="offline"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777520    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="online"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777528    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="ui"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777534    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="registry"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777540    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="online"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777545    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="ui"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777550    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a74aa3-895e-4a8b-badf-12ab944c7e4d" containerName="offline"
Jul 20 15:48:39.778236 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.777557    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1098a370-29c7-4d30-86c4-6353a7f1c79c" containerName="offline"
Jul 20 15:48:39.782242 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.782223    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.784011 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.783994    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 20 15:48:39.784086 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.783993    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:48:39.784134 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.784083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-vjhhx\""
Jul 20 15:48:39.784533 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.784519    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:48:39.787834 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.787798    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:48:39.821952 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.821917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrwq\" (UniqueName: \"kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.822123 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.822001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.922887 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.922847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.922887 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.922892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrwq\" (UniqueName: \"kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.923243 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.923221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:39.931468 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:39.931446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrwq\" (UniqueName: \"kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq\") pod \"postgres-864846d4f5-2kqfq\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") " pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:40.103670 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:40.103588    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:48:40.227567 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:40.227535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:48:40.230770 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:48:40.230718    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddf6943d_8ba3_4825_89d6_51f50d0ffcbf.slice/crio-0d96c66eb91ccfa1a0259fecbaff901ca6d3b23cb8351de759af7ab299b558e3 WatchSource:0}: Error finding container 0d96c66eb91ccfa1a0259fecbaff901ca6d3b23cb8351de759af7ab299b558e3: Status 404 returned error can't find the container with id 0d96c66eb91ccfa1a0259fecbaff901ca6d3b23cb8351de759af7ab299b558e3
Jul 20 15:48:40.232495 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:40.232477    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:48:40.754766 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:40.754720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2kqfq" event={"ID":"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf","Type":"ContainerStarted","Data":"0d96c66eb91ccfa1a0259fecbaff901ca6d3b23cb8351de759af7ab299b558e3"}
Jul 20 15:48:45.778458 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:45.778410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2kqfq" event={"ID":"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf","Type":"ContainerStarted","Data":"d1b1ceed808065dcc4106a5d849aaf67ce700b4918725cdab7724a11d40b6cb3"}
Jul 20 15:48:45.792794 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:45.792718    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-2kqfq" podStartSLOduration=1.702612929 podStartE2EDuration="6.792698816s" totalImagesPullingTime="5.090085887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:48:45.791533513 +0000 UTC m=+894.333261197" watchObservedRunningTime="2026-07-20 15:48:45.792698816 +0000 UTC m=+894.334426504"
Jul 20 15:48:48.413871 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.413836    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:48:48.422668 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.422639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.424943 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.424919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 20 15:48:48.425071 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.424919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 20 15:48:48.425071 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.424959    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 20 15:48:48.425193 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.424967    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 20 15:48:48.425193 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.424982    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-ts5sw\""
Jul 20 15:48:48.431312 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.430810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:48:48.475247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.475213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.475247 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.475249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.475478 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.475270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.475478 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.475376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g45c\" (UniqueName: \"kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.475478 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.475411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.576451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.576481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576738 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.576501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576738 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:48:48.576616    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Jul 20 15:48:48.576738 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.576619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g45c\" (UniqueName: \"kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576738 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:48:48.576691    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls podName:c304ea5c-e5b9-4489-af10-ec69415d9dc5 nodeName:}" failed. No retries permitted until 2026-07-20 15:48:49.076669638 +0000 UTC m=+897.618397307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls") pod "feast-credit-scoring-fd5dcd499-lz2jx" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5") : secret "feast-credit-scoring-offline-tls" not found
Jul 20 15:48:48.576984 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.576770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.576984 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:48:48.576884    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jul 20 15:48:48.576984 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:48:48.576947    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls podName:c304ea5c-e5b9-4489-af10-ec69415d9dc5 nodeName:}" failed. No retries permitted until 2026-07-20 15:48:49.076929923 +0000 UTC m=+897.618657586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls") pod "feast-credit-scoring-fd5dcd499-lz2jx" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5") : secret "feast-credit-scoring-registry-tls" not found
Jul 20 15:48:48.577142 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.577074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.578972 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.578952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:48.585125 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:48.585103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g45c\" (UniqueName: \"kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.081576 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.081538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.081768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.081622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.084078 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.084051    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.084180 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.084136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") pod \"feast-credit-scoring-fd5dcd499-lz2jx\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") " pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.333485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.333398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:48:49.483267 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.483241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:48:49.484791 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:48:49.484763    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc304ea5c_e5b9_4489_af10_ec69415d9dc5.slice/crio-3db359c8496666b1a2a68af489afaee65f01e889f88bf1d487c898d796d00a51 WatchSource:0}: Error finding container 3db359c8496666b1a2a68af489afaee65f01e889f88bf1d487c898d796d00a51: Status 404 returned error can't find the container with id 3db359c8496666b1a2a68af489afaee65f01e889f88bf1d487c898d796d00a51
Jul 20 15:48:49.796411 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.796371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"d22eac0f207806a11e325f45f112d872f9f99f1b471e52a5f7001238ff06e94e"}
Jul 20 15:48:49.796593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:49.796427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"3db359c8496666b1a2a68af489afaee65f01e889f88bf1d487c898d796d00a51"}
Jul 20 15:48:51.804958 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:51.804925    2558 generic.go:356] "Generic (PLEG): container finished" podID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerID="d22eac0f207806a11e325f45f112d872f9f99f1b471e52a5f7001238ff06e94e" exitCode=0
Jul 20 15:48:51.805343 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:51.804970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"d22eac0f207806a11e325f45f112d872f9f99f1b471e52a5f7001238ff06e94e"}
Jul 20 15:48:52.810951 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:52.810863    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"8dac1d2c883dbc5c8e19517f3bd6ff9738060aa6d59bfcd386bc198ba5c3f3d7"}
Jul 20 15:48:58.835518 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:58.835484    2558 generic.go:356] "Generic (PLEG): container finished" podID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerID="8dac1d2c883dbc5c8e19517f3bd6ff9738060aa6d59bfcd386bc198ba5c3f3d7" exitCode=0
Jul 20 15:48:58.835518 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:58.835523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"8dac1d2c883dbc5c8e19517f3bd6ff9738060aa6d59bfcd386bc198ba5c3f3d7"}
Jul 20 15:48:58.839846 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:58.839824    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 20 15:48:59.844107 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:59.844068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"f53d444a359dcab425fe4ba8064e4aef337022354ebc0048d6ff19f9cbf87ed9"}
Jul 20 15:48:59.844525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:59.844140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"c051420d74517ae51d31f2c568ba2715c7dd9627a1e9e22a20998e97f56d9693"}
Jul 20 15:48:59.844525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:59.844167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerStarted","Data":"a97ea681f5875b79777adca0d23d9a6c80d703ac01ab2eed11d73ae40b35eb5b"}
Jul 20 15:48:59.867443 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:48:59.867384    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podStartSLOduration=11.867362112 podStartE2EDuration="11.867362112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:48:59.865099483 +0000 UTC m=+908.406827210" watchObservedRunningTime="2026-07-20 15:48:59.867362112 +0000 UTC m=+908.409089797"
Jul 20 15:49:01.334413 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.334232    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:01.334413 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.334321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:01.334413 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.334348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:01.337151 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.336472    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Jul 20 15:49:01.337151 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.336531    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Jul 20 15:49:01.337151 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:01.336637    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Jul 20 15:49:04.334091 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:04.334039    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Jul 20 15:49:04.334091 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:04.334069    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Jul 20 15:49:04.334513 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:04.334052    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Jul 20 15:49:07.333977 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.333927    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Jul 20 15:49:07.335005 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.334981    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:07.335426 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.335406    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:07.335869 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.335850    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:07.340137 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.340113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:07.882880 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.882846    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:07.892660 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:07.892631    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:09.333933 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:09.333891    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:10.334421 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:10.334383    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Jul 20 15:49:13.334427 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:13.334391    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:49:13.335177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:49:13.335155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:50:16.995425 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:16.995337    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:50:17.012549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.012518    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:50:17.012734 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.012689    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-2kqfq" podUID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" containerName="postgres" containerID="cri-o://d1b1ceed808065dcc4106a5d849aaf67ce700b4918725cdab7724a11d40b6cb3" gracePeriod=30
Jul 20 15:50:17.164924 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.164883    2558 generic.go:356] "Generic (PLEG): container finished" podID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" containerID="d1b1ceed808065dcc4106a5d849aaf67ce700b4918725cdab7724a11d40b6cb3" exitCode=0
Jul 20 15:50:17.165089 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.164951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2kqfq" event={"ID":"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf","Type":"ContainerDied","Data":"d1b1ceed808065dcc4106a5d849aaf67ce700b4918725cdab7724a11d40b6cb3"}
Jul 20 15:50:17.165348 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.165214    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry" containerID="cri-o://a97ea681f5875b79777adca0d23d9a6c80d703ac01ab2eed11d73ae40b35eb5b" gracePeriod=30
Jul 20 15:50:17.165348 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.165266    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" containerID="cri-o://c051420d74517ae51d31f2c568ba2715c7dd9627a1e9e22a20998e97f56d9693" gracePeriod=30
Jul 20 15:50:17.165526 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.165266    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline" containerID="cri-o://f53d444a359dcab425fe4ba8064e4aef337022354ebc0048d6ff19f9cbf87ed9" gracePeriod=30
Jul 20 15:50:17.274681 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.274645    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:50:17.369275 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.369244    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata\") pod \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") "
Jul 20 15:50:17.369466 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.369332    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jrwq\" (UniqueName: \"kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq\") pod \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\" (UID: \"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf\") "
Jul 20 15:50:17.371433 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.371401    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq" (OuterVolumeSpecName: "kube-api-access-9jrwq") pod "ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" (UID: "ddf6943d-8ba3-4825-89d6-51f50d0ffcbf"). InnerVolumeSpecName "kube-api-access-9jrwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:50:17.398487 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.398458    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" (UID: "ddf6943d-8ba3-4825-89d6-51f50d0ffcbf"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:50:17.470770 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.470705    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-postgresdata\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:17.470770 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.470733    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jrwq\" (UniqueName: \"kubernetes.io/projected/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf-kube-api-access-9jrwq\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:17.883809 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:17.883776    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Jul 20 15:50:18.171826 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.171796    2558 generic.go:356] "Generic (PLEG): container finished" podID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerID="c051420d74517ae51d31f2c568ba2715c7dd9627a1e9e22a20998e97f56d9693" exitCode=0
Jul 20 15:50:18.172241 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.171864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"c051420d74517ae51d31f2c568ba2715c7dd9627a1e9e22a20998e97f56d9693"}
Jul 20 15:50:18.173059 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.173040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2kqfq" event={"ID":"ddf6943d-8ba3-4825-89d6-51f50d0ffcbf","Type":"ContainerDied","Data":"0d96c66eb91ccfa1a0259fecbaff901ca6d3b23cb8351de759af7ab299b558e3"}
Jul 20 15:50:18.173121 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.173057    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2kqfq"
Jul 20 15:50:18.173121 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.173076    2558 scope.go:117] "RemoveContainer" containerID="d1b1ceed808065dcc4106a5d849aaf67ce700b4918725cdab7724a11d40b6cb3"
Jul 20 15:50:18.196036 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.196007    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:50:18.198955 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.198932    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2kqfq"]
Jul 20 15:50:18.498462 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:18.498387    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" path="/var/lib/kubelet/pods/ddf6943d-8ba3-4825-89d6-51f50d0ffcbf/volumes"
Jul 20 15:50:27.883861 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:27.883821    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Jul 20 15:50:37.883133 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:37.883086    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Jul 20 15:50:37.883652 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:37.883225    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:50:47.283873 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.283837    2558 generic.go:356] "Generic (PLEG): container finished" podID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerID="f53d444a359dcab425fe4ba8064e4aef337022354ebc0048d6ff19f9cbf87ed9" exitCode=137
Jul 20 15:50:47.283873 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.283864    2558 generic.go:356] "Generic (PLEG): container finished" podID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerID="a97ea681f5875b79777adca0d23d9a6c80d703ac01ab2eed11d73ae40b35eb5b" exitCode=137
Jul 20 15:50:47.284291 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.283905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"f53d444a359dcab425fe4ba8064e4aef337022354ebc0048d6ff19f9cbf87ed9"}
Jul 20 15:50:47.284291 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.283953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"a97ea681f5875b79777adca0d23d9a6c80d703ac01ab2eed11d73ae40b35eb5b"}
Jul 20 15:50:47.335870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.335841    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Jul 20 15:50:47.816872 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.816849    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:50:47.885659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.885628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls\") pod \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") "
Jul 20 15:50:47.885659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.885664    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data\") pod \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") "
Jul 20 15:50:47.885875 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.885722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g45c\" (UniqueName: \"kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c\") pod \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") "
Jul 20 15:50:47.885875 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.885740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") pod \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") "
Jul 20 15:50:47.885875 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.885783    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") pod \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\" (UID: \"c304ea5c-e5b9-4489-af10-ec69415d9dc5\") "
Jul 20 15:50:47.887808 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.887764    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c304ea5c-e5b9-4489-af10-ec69415d9dc5" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:50:47.887934 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.887820    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls" (OuterVolumeSpecName: "online-tls") pod "c304ea5c-e5b9-4489-af10-ec69415d9dc5" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:50:47.887934 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.887910    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c" (OuterVolumeSpecName: "kube-api-access-5g45c") pod "c304ea5c-e5b9-4489-af10-ec69415d9dc5" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5"). InnerVolumeSpecName "kube-api-access-5g45c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:50:47.888473 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.888446    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c304ea5c-e5b9-4489-af10-ec69415d9dc5" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:50:47.894179 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.894152    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data" (OuterVolumeSpecName: "feast-data") pod "c304ea5c-e5b9-4489-af10-ec69415d9dc5" (UID: "c304ea5c-e5b9-4489-af10-ec69415d9dc5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:50:47.986708 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.986628    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:47.986708 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.986656    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c304ea5c-e5b9-4489-af10-ec69415d9dc5-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:47.986708 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.986665    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g45c\" (UniqueName: \"kubernetes.io/projected/c304ea5c-e5b9-4489-af10-ec69415d9dc5-kube-api-access-5g45c\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:47.986708 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.986676    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:47.986708 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:47.986684    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c304ea5c-e5b9-4489-af10-ec69415d9dc5-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:50:48.290281 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.290192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx" event={"ID":"c304ea5c-e5b9-4489-af10-ec69415d9dc5","Type":"ContainerDied","Data":"3db359c8496666b1a2a68af489afaee65f01e889f88bf1d487c898d796d00a51"}
Jul 20 15:50:48.290281 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.290214    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"
Jul 20 15:50:48.290799 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.290296    2558 scope.go:117] "RemoveContainer" containerID="f53d444a359dcab425fe4ba8064e4aef337022354ebc0048d6ff19f9cbf87ed9"
Jul 20 15:50:48.299470 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.299446    2558 scope.go:117] "RemoveContainer" containerID="c051420d74517ae51d31f2c568ba2715c7dd9627a1e9e22a20998e97f56d9693"
Jul 20 15:50:48.307006 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.306984    2558 scope.go:117] "RemoveContainer" containerID="a97ea681f5875b79777adca0d23d9a6c80d703ac01ab2eed11d73ae40b35eb5b"
Jul 20 15:50:48.313382 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.313360    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:50:48.314674 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.314651    2558 scope.go:117] "RemoveContainer" containerID="8dac1d2c883dbc5c8e19517f3bd6ff9738060aa6d59bfcd386bc198ba5c3f3d7"
Jul 20 15:50:48.316958 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.316935    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-fd5dcd499-lz2jx"]
Jul 20 15:50:48.321720 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.321704    2558 scope.go:117] "RemoveContainer" containerID="d22eac0f207806a11e325f45f112d872f9f99f1b471e52a5f7001238ff06e94e"
Jul 20 15:50:48.498906 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:50:48.498876    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" path="/var/lib/kubelet/pods/c304ea5c-e5b9-4489-af10-ec69415d9dc5/volumes"
Jul 20 15:52:51.206396 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206366    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206650    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="feast-init"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206660    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="feast-init"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206673    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206679    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206685    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206691    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206698    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="feast-apply"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206702    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="feast-apply"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206714    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206719    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206727    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" containerName="postgres"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206732    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" containerName="postgres"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206792    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="registry"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206800    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf6943d-8ba3-4825-89d6-51f50d0ffcbf" containerName="postgres"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206807    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="offline"
Jul 20 15:52:51.206870 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.206813    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c304ea5c-e5b9-4489-af10-ec69415d9dc5" containerName="online"
Jul 20 15:52:51.209587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.209570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:52:51.212427 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.212405    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-d4ktg\""
Jul 20 15:52:51.212963 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.212943    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 20 15:52:51.213016 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.212948    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 20 15:52:51.231704 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.231675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:52:51.294111 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.294080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr567\" (UniqueName: \"kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567\") pod \"redis-69bbd798b6-zxcr6\" (UID: \"d3f8ea54-b894-4a1b-86df-93c5216c03b2\") " pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:52:51.395056 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.395020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr567\" (UniqueName: \"kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567\") pod \"redis-69bbd798b6-zxcr6\" (UID: \"d3f8ea54-b894-4a1b-86df-93c5216c03b2\") " pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:52:51.404441 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.404411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr567\" (UniqueName: \"kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567\") pod \"redis-69bbd798b6-zxcr6\" (UID: \"d3f8ea54-b894-4a1b-86df-93c5216c03b2\") " pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:52:51.528937 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.528852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:52:51.665447 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.665414    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:52:51.669184 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:52:51.669149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3f8ea54_b894_4a1b_86df_93c5216c03b2.slice/crio-9756f3098ce60cf371bdf551a48705ece65b0359c8e1421ad5deb3d4406350aa WatchSource:0}: Error finding container 9756f3098ce60cf371bdf551a48705ece65b0359c8e1421ad5deb3d4406350aa: Status 404 returned error can't find the container with id 9756f3098ce60cf371bdf551a48705ece65b0359c8e1421ad5deb3d4406350aa
Jul 20 15:52:51.740654 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:51.740619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" event={"ID":"d3f8ea54-b894-4a1b-86df-93c5216c03b2","Type":"ContainerStarted","Data":"9756f3098ce60cf371bdf551a48705ece65b0359c8e1421ad5deb3d4406350aa"}
Jul 20 15:52:53.754734 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:53.754696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" event={"ID":"d3f8ea54-b894-4a1b-86df-93c5216c03b2","Type":"ContainerStarted","Data":"81112e35d0daaefb62fe4d99c291ad5ddeb61f6bce2339c68fbbe81d06ee3a3c"}
Jul 20 15:52:53.778575 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:53.778521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" podStartSLOduration=1.244110966 podStartE2EDuration="2.778502755s" totalImagesPullingTime="1.534391789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:52:53.777239397 +0000 UTC m=+1142.318967081" watchObservedRunningTime="2026-07-20 15:52:53.778502755 +0000 UTC m=+1142.320230444"
Jul 20 15:52:56.706558 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.706528    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:52:56.709683 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.709667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.711817 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.711796    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 20 15:52:56.720304 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.720285    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:52:56.836204 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.836170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8sdm\" (UniqueName: \"kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.836362 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.836218    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.937513 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.937476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8sdm\" (UniqueName: \"kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.937668 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.937521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.937886 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.937870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:56.946684 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:56.946661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8sdm\" (UniqueName: \"kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm\") pod \"postgres-864846d4f5-cj596\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") " pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:57.018883 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:57.018790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:52:57.141948 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:57.141793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:52:57.144317 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:52:57.144290    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod621b40c3_490e_49e1_a423_1903816cb60b.slice/crio-7d05d9ed3c7466690b2307f248fe51e919a28f43d6bdde6ec5740e295692c1b3 WatchSource:0}: Error finding container 7d05d9ed3c7466690b2307f248fe51e919a28f43d6bdde6ec5740e295692c1b3: Status 404 returned error can't find the container with id 7d05d9ed3c7466690b2307f248fe51e919a28f43d6bdde6ec5740e295692c1b3
Jul 20 15:52:57.773154 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:57.773117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" event={"ID":"621b40c3-490e-49e1-a423-1903816cb60b","Type":"ContainerStarted","Data":"1e9e316606a5a502379d81c98de3e7644c5a9bf8d8eeff502e95d709eec933ca"}
Jul 20 15:52:57.773154 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:57.773159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" event={"ID":"621b40c3-490e-49e1-a423-1903816cb60b","Type":"ContainerStarted","Data":"7d05d9ed3c7466690b2307f248fe51e919a28f43d6bdde6ec5740e295692c1b3"}
Jul 20 15:52:57.790508 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:52:57.790458    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" podStartSLOduration=1.790442571 podStartE2EDuration="1.790442571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:52:57.788414647 +0000 UTC m=+1146.330142332" watchObservedRunningTime="2026-07-20 15:52:57.790442571 +0000 UTC m=+1146.332170254"
Jul 20 15:53:02.258932 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.258901    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:53:02.265199 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.265177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.267206 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.267181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 20 15:53:02.267627 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.267607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-ms6bc\""
Jul 20 15:53:02.268185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.268165    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 20 15:53:02.268296 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.268184    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 20 15:53:02.274489 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.274466    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:53:02.377325 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.377285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjqp\" (UniqueName: \"kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.377493 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.377346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.377493 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.377448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.377493 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.377478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.478379 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.478340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.478563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.478397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjqp\" (UniqueName: \"kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.478563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.478430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.478563 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.478456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.478894 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.478875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.481032 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.481006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.481159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.481006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.487404 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.487375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjqp\" (UniqueName: \"kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp\") pod \"feast-credit-scoring-858587677c-qfmzx\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") " pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.575515 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.575433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:02.715606 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.715574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:53:02.718500 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:53:02.718475    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec72150e_c10b_4eba_88b8_b0ca24bbb76d.slice/crio-f1b0356d4113ed982ce9148f3ba7554fab8f7d02fb5250ffd89d60deb6d56227 WatchSource:0}: Error finding container f1b0356d4113ed982ce9148f3ba7554fab8f7d02fb5250ffd89d60deb6d56227: Status 404 returned error can't find the container with id f1b0356d4113ed982ce9148f3ba7554fab8f7d02fb5250ffd89d60deb6d56227
Jul 20 15:53:02.794107 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.794078    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerStarted","Data":"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"}
Jul 20 15:53:02.794266 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:02.794130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerStarted","Data":"f1b0356d4113ed982ce9148f3ba7554fab8f7d02fb5250ffd89d60deb6d56227"}
Jul 20 15:53:03.798984 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:03.798946    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerID="422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8" exitCode=0
Jul 20 15:53:03.799346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:03.799015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerDied","Data":"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"}
Jul 20 15:53:04.806650 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:04.806613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerStarted","Data":"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"}
Jul 20 15:53:10.831548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:10.831458    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerID="c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab" exitCode=0
Jul 20 15:53:10.831548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:10.831497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerDied","Data":"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"}
Jul 20 15:53:11.838098 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:11.838060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerStarted","Data":"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"}
Jul 20 15:53:11.838528 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:11.838140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerStarted","Data":"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"}
Jul 20 15:53:11.859471 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:11.859309    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podStartSLOduration=9.859289444 podStartE2EDuration="9.859289444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:53:11.857879883 +0000 UTC m=+1160.399607570" watchObservedRunningTime="2026-07-20 15:53:11.859289444 +0000 UTC m=+1160.401017128"
Jul 20 15:53:12.575999 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:12.575963    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:12.576170 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:12.576024    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:14.576288 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:14.576187    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:14.576775 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:14.576288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:14.577732 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:14.577695    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Jul 20 15:53:14.577854 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:14.577710    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 20 15:53:17.576156 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:17.576106    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Jul 20 15:53:17.581595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:17.581560    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:17.584962 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:17.584939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:20.576394 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:20.576335    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Jul 20 15:53:23.576997 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:23.576966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:23.577641 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:23.577623    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:53:28.259286 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.259246    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:53:28.264239 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.264221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.267208 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.267174    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 20 15:53:28.267208 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.267180    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-d9rv4\""
Jul 20 15:53:28.267427 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.267411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 20 15:53:28.267549 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.267533    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 20 15:53:28.275119 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.275095    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:53:28.278872 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.278850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.278991 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.278889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.278991 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.278936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65js2\" (UniqueName: \"kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.278991 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.278988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.380239 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.380203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.380420 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.380260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.380420 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.380301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65js2\" (UniqueName: \"kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.380420 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.380343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.380731 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.380700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.383015 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.382993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.383120 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.383046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.390270 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.390244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65js2\" (UniqueName: \"kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2\") pod \"feast-driver-ranking-6895d946fd-6n9wk\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") " pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.574635 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.574550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:28.705791 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.705763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:53:28.708255 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:53:28.708232    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb5fc6c_cbec_47ae_9f8c_a3f79b695815.slice/crio-4324af2b7aa31a0cb2dac2e9da0a4db8f91d0c7ee31a3b90990c6f7f1962bebb WatchSource:0}: Error finding container 4324af2b7aa31a0cb2dac2e9da0a4db8f91d0c7ee31a3b90990c6f7f1962bebb: Status 404 returned error can't find the container with id 4324af2b7aa31a0cb2dac2e9da0a4db8f91d0c7ee31a3b90990c6f7f1962bebb
Jul 20 15:53:28.913078 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.913041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerStarted","Data":"784342a62f1340800795a8674db03bc1050b4791207ac20c6783347a7682c707"}
Jul 20 15:53:28.913269 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:28.913099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerStarted","Data":"4324af2b7aa31a0cb2dac2e9da0a4db8f91d0c7ee31a3b90990c6f7f1962bebb"}
Jul 20 15:53:33.940588 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:33.940550    2558 generic.go:356] "Generic (PLEG): container finished" podID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerID="784342a62f1340800795a8674db03bc1050b4791207ac20c6783347a7682c707" exitCode=0
Jul 20 15:53:33.940999 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:33.940626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerDied","Data":"784342a62f1340800795a8674db03bc1050b4791207ac20c6783347a7682c707"}
Jul 20 15:53:34.946636 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:34.946591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerStarted","Data":"396c70cf36a1e79688946e75c2b167ee23834a4823d08fc45416f4965eda2481"}
Jul 20 15:53:40.972919 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:40.972880    2558 generic.go:356] "Generic (PLEG): container finished" podID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerID="396c70cf36a1e79688946e75c2b167ee23834a4823d08fc45416f4965eda2481" exitCode=0
Jul 20 15:53:40.973306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:40.972948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerDied","Data":"396c70cf36a1e79688946e75c2b167ee23834a4823d08fc45416f4965eda2481"}
Jul 20 15:53:41.980330 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:41.980289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerStarted","Data":"49fcd755b2fed2ef14f98863ef062ed51cfc965bdd8d97d743b554581a97b9b2"}
Jul 20 15:53:41.980874 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:41.980362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerStarted","Data":"db4d3f5a1143ed0b5d8dff8d42a1a81b6b3640b60ce8f16e7754891bf6d2e052"}
Jul 20 15:53:42.002501 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:42.002448    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podStartSLOduration=14.00243101 podStartE2EDuration="14.00243101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:53:42.000431652 +0000 UTC m=+1190.542159358" watchObservedRunningTime="2026-07-20 15:53:42.00243101 +0000 UTC m=+1190.544158696"
Jul 20 15:53:43.575456 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:43.575418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:43.575944 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:43.575489    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:43.576973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:43.576938    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Jul 20 15:53:43.577060 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:43.576968    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 20 15:53:46.575881 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:46.575831    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Jul 20 15:53:46.575881 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:46.575865    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 20 15:53:48.575092 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:48.575056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:48.575573 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:48.575124    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:49.575326 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:49.575278    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Jul 20 15:53:49.580992 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:49.580965    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:49.584355 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:49.584330    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:52.576042 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:52.576009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:53:52.576840 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:53:52.576821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:55:08.509582 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.509547    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:55:08.510105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.509796    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" podUID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" containerName="manager" containerID="cri-o://63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536" gracePeriod=10
Jul 20 15:55:08.762849 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.762783    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:55:08.798545 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.798513    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:55:08.798937 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.798790    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry" containerID="cri-o://0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a" gracePeriod=30
Jul 20 15:55:08.798937 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.798850    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online" containerID="cri-o://10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a" gracePeriod=30
Jul 20 15:55:08.819156 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.819119    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:55:08.819385 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.819359    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry" containerID="cri-o://db4d3f5a1143ed0b5d8dff8d42a1a81b6b3640b60ce8f16e7754891bf6d2e052" gracePeriod=30
Jul 20 15:55:08.819458 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.819378    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" containerID="cri-o://49fcd755b2fed2ef14f98863ef062ed51cfc965bdd8d97d743b554581a97b9b2" gracePeriod=30
Jul 20 15:55:08.879660 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.879628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mt7c\" (UniqueName: \"kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c\") pod \"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa\" (UID: \"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa\") "
Jul 20 15:55:08.881660 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.881634    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c" (OuterVolumeSpecName: "kube-api-access-8mt7c") pod "9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" (UID: "9f7f47ab-2db8-46f6-835b-e7d5f560a8aa"). InnerVolumeSpecName "kube-api-access-8mt7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:08.980815 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:08.980783    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mt7c\" (UniqueName: \"kubernetes.io/projected/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa-kube-api-access-8mt7c\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:09.341337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.341300    2558 generic.go:356] "Generic (PLEG): container finished" podID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" containerID="63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536" exitCode=0
Jul 20 15:55:09.341548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.341348    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"
Jul 20 15:55:09.341548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.341388    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" event={"ID":"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa","Type":"ContainerDied","Data":"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"}
Jul 20 15:55:09.341548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.341446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl" event={"ID":"9f7f47ab-2db8-46f6-835b-e7d5f560a8aa","Type":"ContainerDied","Data":"763cb57e2ca6704c8a34fae1e258c83c6fdd5a226bb3945dfb445087bb0728eb"}
Jul 20 15:55:09.341548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.341475    2558 scope.go:117] "RemoveContainer" containerID="63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"
Jul 20 15:55:09.350672 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.350652    2558 scope.go:117] "RemoveContainer" containerID="63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"
Jul 20 15:55:09.351000 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:09.350969    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536\": container with ID starting with 63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536 not found: ID does not exist" containerID="63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"
Jul 20 15:55:09.351111 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.351006    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536"} err="failed to get container status \"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536\": rpc error: code = NotFound desc = could not find container \"63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536\": container with ID starting with 63e479507c4a361bf00a2aa52e17c9b34883f8d70ac567f8e58b1b381e4f1536 not found: ID does not exist"
Jul 20 15:55:09.362607 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.362576    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:55:09.368063 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.368039    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5dc7f95ccd-sbwjl"]
Jul 20 15:55:09.582241 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:09.582201    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 20 15:55:10.151068 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.151033    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:55:10.151282 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.151198    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" podUID="621b40c3-490e-49e1-a423-1903816cb60b" containerName="postgres" containerID="cri-o://1e9e316606a5a502379d81c98de3e7644c5a9bf8d8eeff502e95d709eec933ca" gracePeriod=30
Jul 20 15:55:10.161215 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.161180    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:55:10.161338 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.161321    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" podUID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" containerName="redis" containerID="cri-o://81112e35d0daaefb62fe4d99c291ad5ddeb61f6bce2339c68fbbe81d06ee3a3c" gracePeriod=30
Jul 20 15:55:10.346364 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.346336    2558 generic.go:356] "Generic (PLEG): container finished" podID="621b40c3-490e-49e1-a423-1903816cb60b" containerID="1e9e316606a5a502379d81c98de3e7644c5a9bf8d8eeff502e95d709eec933ca" exitCode=0
Jul 20 15:55:10.346505 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.346408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" event={"ID":"621b40c3-490e-49e1-a423-1903816cb60b","Type":"ContainerDied","Data":"1e9e316606a5a502379d81c98de3e7644c5a9bf8d8eeff502e95d709eec933ca"}
Jul 20 15:55:10.355397 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.355370    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerID="10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a" exitCode=0
Jul 20 15:55:10.355525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.355453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerDied","Data":"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"}
Jul 20 15:55:10.356961 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.356938    2558 generic.go:356] "Generic (PLEG): container finished" podID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" containerID="81112e35d0daaefb62fe4d99c291ad5ddeb61f6bce2339c68fbbe81d06ee3a3c" exitCode=0
Jul 20 15:55:10.357054 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.357011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" event={"ID":"d3f8ea54-b894-4a1b-86df-93c5216c03b2","Type":"ContainerDied","Data":"81112e35d0daaefb62fe4d99c291ad5ddeb61f6bce2339c68fbbe81d06ee3a3c"}
Jul 20 15:55:10.359362 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.359345    2558 generic.go:356] "Generic (PLEG): container finished" podID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerID="49fcd755b2fed2ef14f98863ef062ed51cfc965bdd8d97d743b554581a97b9b2" exitCode=0
Jul 20 15:55:10.359432 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.359393    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerDied","Data":"49fcd755b2fed2ef14f98863ef062ed51cfc965bdd8d97d743b554581a97b9b2"}
Jul 20 15:55:10.419574 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.419553    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:55:10.422059 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.422041    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:55:10.493312 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.493280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8sdm\" (UniqueName: \"kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm\") pod \"621b40c3-490e-49e1-a423-1903816cb60b\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") "
Jul 20 15:55:10.493487 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.493425    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr567\" (UniqueName: \"kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567\") pod \"d3f8ea54-b894-4a1b-86df-93c5216c03b2\" (UID: \"d3f8ea54-b894-4a1b-86df-93c5216c03b2\") "
Jul 20 15:55:10.493487 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.493450    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata\") pod \"621b40c3-490e-49e1-a423-1903816cb60b\" (UID: \"621b40c3-490e-49e1-a423-1903816cb60b\") "
Jul 20 15:55:10.495498 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.495463    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm" (OuterVolumeSpecName: "kube-api-access-r8sdm") pod "621b40c3-490e-49e1-a423-1903816cb60b" (UID: "621b40c3-490e-49e1-a423-1903816cb60b"). InnerVolumeSpecName "kube-api-access-r8sdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:10.495699 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.495680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567" (OuterVolumeSpecName: "kube-api-access-tr567") pod "d3f8ea54-b894-4a1b-86df-93c5216c03b2" (UID: "d3f8ea54-b894-4a1b-86df-93c5216c03b2"). InnerVolumeSpecName "kube-api-access-tr567". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:10.498801 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.498742    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" path="/var/lib/kubelet/pods/9f7f47ab-2db8-46f6-835b-e7d5f560a8aa/volumes"
Jul 20 15:55:10.523842 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.523811    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "621b40c3-490e-49e1-a423-1903816cb60b" (UID: "621b40c3-490e-49e1-a423-1903816cb60b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:55:10.594104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.594064    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr567\" (UniqueName: \"kubernetes.io/projected/d3f8ea54-b894-4a1b-86df-93c5216c03b2-kube-api-access-tr567\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:10.594104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.594098    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/621b40c3-490e-49e1-a423-1903816cb60b-postgresdata\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:10.594104 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:10.594111    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8sdm\" (UniqueName: \"kubernetes.io/projected/621b40c3-490e-49e1-a423-1903816cb60b-kube-api-access-r8sdm\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:11.363974 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.363946    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6"
Jul 20 15:55:11.364164 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.363992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zxcr6" event={"ID":"d3f8ea54-b894-4a1b-86df-93c5216c03b2","Type":"ContainerDied","Data":"9756f3098ce60cf371bdf551a48705ece65b0359c8e1421ad5deb3d4406350aa"}
Jul 20 15:55:11.364164 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.364047    2558 scope.go:117] "RemoveContainer" containerID="81112e35d0daaefb62fe4d99c291ad5ddeb61f6bce2339c68fbbe81d06ee3a3c"
Jul 20 15:55:11.365253 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.365237    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-cj596"
Jul 20 15:55:11.365336 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.365241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-cj596" event={"ID":"621b40c3-490e-49e1-a423-1903816cb60b","Type":"ContainerDied","Data":"7d05d9ed3c7466690b2307f248fe51e919a28f43d6bdde6ec5740e295692c1b3"}
Jul 20 15:55:11.373963 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.373882    2558 scope.go:117] "RemoveContainer" containerID="1e9e316606a5a502379d81c98de3e7644c5a9bf8d8eeff502e95d709eec933ca"
Jul 20 15:55:11.383240 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.383215    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:55:11.391600 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.391578    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zxcr6"]
Jul 20 15:55:11.400869 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.400848    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:55:11.405248 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:11.405228    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-cj596"]
Jul 20 15:55:12.498869 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:12.498839    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="621b40c3-490e-49e1-a423-1903816cb60b" path="/var/lib/kubelet/pods/621b40c3-490e-49e1-a423-1903816cb60b/volumes"
Jul 20 15:55:12.499234 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:12.499131    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" path="/var/lib/kubelet/pods/d3f8ea54-b894-4a1b-86df-93c5216c03b2/volumes"
Jul 20 15:55:17.582630 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:17.582591    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 20 15:55:19.582150 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:19.582106    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 20 15:55:27.582327 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:27.582281    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 20 15:55:29.581982 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:29.581942    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Jul 20 15:55:29.582408 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:29.582048    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:55:37.582593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:37.582542    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Jul 20 15:55:37.583171 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:37.582697    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:55:39.453625 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.453604    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:55:39.473946 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.473920    2558 generic.go:356] "Generic (PLEG): container finished" podID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerID="db4d3f5a1143ed0b5d8dff8d42a1a81b6b3640b60ce8f16e7754891bf6d2e052" exitCode=137
Jul 20 15:55:39.474053 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.473985    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerDied","Data":"db4d3f5a1143ed0b5d8dff8d42a1a81b6b3640b60ce8f16e7754891bf6d2e052"}
Jul 20 15:55:39.476438 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.476402    2558 generic.go:356] "Generic (PLEG): container finished" podID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerID="0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a" exitCode=137
Jul 20 15:55:39.476589 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.476435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerDied","Data":"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"}
Jul 20 15:55:39.476589 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.476502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx" event={"ID":"ec72150e-c10b-4eba-88b8-b0ca24bbb76d","Type":"ContainerDied","Data":"f1b0356d4113ed982ce9148f3ba7554fab8f7d02fb5250ffd89d60deb6d56227"}
Jul 20 15:55:39.476589 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.476513    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"
Jul 20 15:55:39.476589 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.476535    2558 scope.go:117] "RemoveContainer" containerID="10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"
Jul 20 15:55:39.485372 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.485354    2558 scope.go:117] "RemoveContainer" containerID="0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"
Jul 20 15:55:39.487743 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.487722    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:55:39.492807 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.492792    2558 scope.go:117] "RemoveContainer" containerID="c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"
Jul 20 15:55:39.499648 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.499634    2558 scope.go:117] "RemoveContainer" containerID="422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"
Jul 20 15:55:39.507214 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.507195    2558 scope.go:117] "RemoveContainer" containerID="10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"
Jul 20 15:55:39.507471 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:39.507446    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a\": container with ID starting with 10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a not found: ID does not exist" containerID="10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"
Jul 20 15:55:39.507547 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.507481    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a"} err="failed to get container status \"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a\": rpc error: code = NotFound desc = could not find container \"10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a\": container with ID starting with 10889e2e92d911901f115b360bb644d0a82c94826496e2abac3b99d7c3af452a not found: ID does not exist"
Jul 20 15:55:39.507547 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.507505    2558 scope.go:117] "RemoveContainer" containerID="0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"
Jul 20 15:55:39.507871 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:39.507736    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a\": container with ID starting with 0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a not found: ID does not exist" containerID="0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"
Jul 20 15:55:39.507871 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.507847    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a"} err="failed to get container status \"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a\": rpc error: code = NotFound desc = could not find container \"0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a\": container with ID starting with 0b3c37774565d1a6e2bc8a8744c1aa7b1abb2e77e96e20d7254774601a8ebf3a not found: ID does not exist"
Jul 20 15:55:39.507871 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.507870    2558 scope.go:117] "RemoveContainer" containerID="c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"
Jul 20 15:55:39.508129 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:39.508112    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab\": container with ID starting with c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab not found: ID does not exist" containerID="c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"
Jul 20 15:55:39.508197 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.508137    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab"} err="failed to get container status \"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab\": rpc error: code = NotFound desc = could not find container \"c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab\": container with ID starting with c64e621197b4f487b424dbb422965cf93b7ce31d78322d9aec3b19d4e912c3ab not found: ID does not exist"
Jul 20 15:55:39.508197 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.508169    2558 scope.go:117] "RemoveContainer" containerID="422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"
Jul 20 15:55:39.508401 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:39.508384    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8\": container with ID starting with 422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8 not found: ID does not exist" containerID="422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"
Jul 20 15:55:39.508437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.508405    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8"} err="failed to get container status \"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8\": rpc error: code = NotFound desc = could not find container \"422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8\": container with ID starting with 422903d7f57039593d915687ebe7edaf2e0afb7622b432c850e01fd4f49c2ea8 not found: ID does not exist"
Jul 20 15:55:39.518768 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518736    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65js2\" (UniqueName: \"kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2\") pod \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") "
Jul 20 15:55:39.518877 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518782    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data\") pod \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") "
Jul 20 15:55:39.518877 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518803    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls\") pod \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") "
Jul 20 15:55:39.518877 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518827    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txjqp\" (UniqueName: \"kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp\") pod \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") "
Jul 20 15:55:39.519043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518930    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls\") pod \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") "
Jul 20 15:55:39.519043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518959    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls\") pod \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\" (UID: \"ec72150e-c10b-4eba-88b8-b0ca24bbb76d\") "
Jul 20 15:55:39.519043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.518991    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data\") pod \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") "
Jul 20 15:55:39.519043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.519017    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls\") pod \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\" (UID: \"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815\") "
Jul 20 15:55:39.519510 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.519470    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data" (OuterVolumeSpecName: "feast-data") pod "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" (UID: "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:55:39.521046 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" (UID: "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:55:39.521266 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521224    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls" (OuterVolumeSpecName: "online-tls") pod "ec72150e-c10b-4eba-88b8-b0ca24bbb76d" (UID: "ec72150e-c10b-4eba-88b8-b0ca24bbb76d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:55:39.521366 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521347    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp" (OuterVolumeSpecName: "kube-api-access-txjqp") pod "ec72150e-c10b-4eba-88b8-b0ca24bbb76d" (UID: "ec72150e-c10b-4eba-88b8-b0ca24bbb76d"). InnerVolumeSpecName "kube-api-access-txjqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:39.521417 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521383    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ec72150e-c10b-4eba-88b8-b0ca24bbb76d" (UID: "ec72150e-c10b-4eba-88b8-b0ca24bbb76d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:55:39.521497 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521479    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls" (OuterVolumeSpecName: "online-tls") pod "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" (UID: "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:55:39.521639 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.521613    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2" (OuterVolumeSpecName: "kube-api-access-65js2") pod "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" (UID: "ebb5fc6c-cbec-47ae-9f8c-a3f79b695815"). InnerVolumeSpecName "kube-api-access-65js2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:39.528614 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.528594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data" (OuterVolumeSpecName: "feast-data") pod "ec72150e-c10b-4eba-88b8-b0ca24bbb76d" (UID: "ec72150e-c10b-4eba-88b8-b0ca24bbb76d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:55:39.620322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620251    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620292    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620302    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65js2\" (UniqueName: \"kubernetes.io/projected/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-kube-api-access-65js2\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620312    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620321    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620573 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620329    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txjqp\" (UniqueName: \"kubernetes.io/projected/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-kube-api-access-txjqp\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620573 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620337    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.620573 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.620345    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec72150e-c10b-4eba-88b8-b0ca24bbb76d-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.803333 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.803303    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:55:39.811136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:39.811116    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-858587677c-qfmzx"]
Jul 20 15:55:40.482271 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.482242    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"
Jul 20 15:55:40.482271 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.482260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk" event={"ID":"ebb5fc6c-cbec-47ae-9f8c-a3f79b695815","Type":"ContainerDied","Data":"4324af2b7aa31a0cb2dac2e9da0a4db8f91d0c7ee31a3b90990c6f7f1962bebb"}
Jul 20 15:55:40.482827 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.482366    2558 scope.go:117] "RemoveContainer" containerID="49fcd755b2fed2ef14f98863ef062ed51cfc965bdd8d97d743b554581a97b9b2"
Jul 20 15:55:40.491228 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.491209    2558 scope.go:117] "RemoveContainer" containerID="db4d3f5a1143ed0b5d8dff8d42a1a81b6b3640b60ce8f16e7754891bf6d2e052"
Jul 20 15:55:40.497535 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.497510    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" path="/var/lib/kubelet/pods/ec72150e-c10b-4eba-88b8-b0ca24bbb76d/volumes"
Jul 20 15:55:40.498711 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.498693    2558 scope.go:117] "RemoveContainer" containerID="396c70cf36a1e79688946e75c2b167ee23834a4823d08fc45416f4965eda2481"
Jul 20 15:55:40.505989 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.505958    2558 scope.go:117] "RemoveContainer" containerID="784342a62f1340800795a8674db03bc1050b4791207ac20c6783347a7682c707"
Jul 20 15:55:40.506638 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.506619    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:55:40.515056 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:40.515034    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6895d946fd-6n9wk"]
Jul 20 15:55:42.499250 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:42.499218    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" path="/var/lib/kubelet/pods/ebb5fc6c-cbec-47ae-9f8c-a3f79b695815/volumes"
Jul 20 15:55:53.513210 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513172    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513448    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="feast-apply"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513458    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="feast-apply"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513468    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="feast-init"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513474    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="feast-init"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513482    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513487    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513496    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513501    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513510    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513516    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513526    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" containerName="manager"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513531    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" containerName="manager"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513536    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="feast-apply"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513541    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="feast-apply"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513547    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513552    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513559    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" containerName="redis"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513565    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" containerName="redis"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513570    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="feast-init"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513575    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="feast-init"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513582    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621b40c3-490e-49e1-a423-1903816cb60b" containerName="postgres"
Jul 20 15:55:53.513593 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513588    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="621b40c3-490e-49e1-a423-1903816cb60b" containerName="postgres"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513633    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f8ea54-b894-4a1b-86df-93c5216c03b2" containerName="redis"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513640    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="registry"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513648    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="registry"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513653    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb5fc6c-cbec-47ae-9f8c-a3f79b695815" containerName="online"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513659    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="621b40c3-490e-49e1-a423-1903816cb60b" containerName="postgres"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513664    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec72150e-c10b-4eba-88b8-b0ca24bbb76d" containerName="online"
Jul 20 15:55:53.514337 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.513668    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7f47ab-2db8-46f6-835b-e7d5f560a8aa" containerName="manager"
Jul 20 15:55:53.518365 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.518346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.521257 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.521235    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 15:55:53.521776 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.521757    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 15:55:53.522095 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.522071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 15:55:53.522191 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.522113    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bdw6j\""
Jul 20 15:55:53.522258 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.522211    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 15:55:53.522338 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.522228    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:55:53.522396 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.522347    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:55:53.535769 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.535727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:55:53.622587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxvl\" (UniqueName: \"kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.622764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.622764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.622764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.622764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.622764 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.622761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.723940 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.723899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.723953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.723981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.724001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.724025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:53.724049    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.724070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxvl\" (UniqueName: \"kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.724140 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:53.724094    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:55:53.724493 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:53.724162    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls podName:69a01b69-4324-462f-a657-af1d4c94535c nodeName:}" failed. No retries permitted until 2026-07-20 15:55:54.224139477 +0000 UTC m=+1322.765867140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls") pod "feast-simple-feast-setup-777d6cc998-pwghv" (UID: "69a01b69-4324-462f-a657-af1d4c94535c") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:55:53.724493 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:55:53.724180    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls podName:69a01b69-4324-462f-a657-af1d4c94535c nodeName:}" failed. No retries permitted until 2026-07-20 15:55:54.224171387 +0000 UTC m=+1322.765899048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls") pod "feast-simple-feast-setup-777d6cc998-pwghv" (UID: "69a01b69-4324-462f-a657-af1d4c94535c") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 15:55:53.724615 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.724519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.726617 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.726585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.726737 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.726692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:53.742864 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:53.742844    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxvl\" (UniqueName: \"kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.228644 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.228605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.228876 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.228655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.231070 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.231045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.231160 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.231069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pwghv\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.435283 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.435248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:55:54.580611 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.580580    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:55:54.583810 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:55:54.583785    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69a01b69_4324_462f_a657_af1d4c94535c.slice/crio-0703e96ff996e64e609eb83b6eb05515c91101d882d09b5d21f3b6bf4fbb189c WatchSource:0}: Error finding container 0703e96ff996e64e609eb83b6eb05515c91101d882d09b5d21f3b6bf4fbb189c: Status 404 returned error can't find the container with id 0703e96ff996e64e609eb83b6eb05515c91101d882d09b5d21f3b6bf4fbb189c
Jul 20 15:55:54.585622 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:54.585604    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:55:55.542014 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:55:55.541928    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"0703e96ff996e64e609eb83b6eb05515c91101d882d09b5d21f3b6bf4fbb189c"}
Jul 20 15:56:08.597618 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:08.597579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"}
Jul 20 15:56:12.614033 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:12.613942    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b" exitCode=0
Jul 20 15:56:12.614033 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:12.614010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"}
Jul 20 15:56:13.619596 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:13.619563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"}
Jul 20 15:56:18.640947 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:18.640914    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b" exitCode=0
Jul 20 15:56:18.641319 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:18.640984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"}
Jul 20 15:56:19.650702 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:19.650665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"}
Jul 20 15:56:19.651177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:19.650726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"}
Jul 20 15:56:19.651177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:19.650767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"}
Jul 20 15:56:19.651177 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:19.650787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerStarted","Data":"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"}
Jul 20 15:56:19.675637 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:19.675569    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podStartSLOduration=13.676614225 podStartE2EDuration="26.675544532s" totalImagesPullingTime="12.998930307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:56:19.672869334 +0000 UTC m=+1348.214597048" watchObservedRunningTime="2026-07-20 15:56:19.675544532 +0000 UTC m=+1348.217272217"
Jul 20 15:56:21.435953 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.435851    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:21.435953 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.435925    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:21.435953 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.435946    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:21.436570 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.436103    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:21.438162 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.438116    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Jul 20 15:56:21.438162 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.438148    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jul 20 15:56:21.438370 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.438174    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jul 20 15:56:21.438370 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:21.438230    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Jul 20 15:56:24.435667 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435629    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.436159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435773    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.436159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435802    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.436159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.436159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435921    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jul 20 15:56:24.436159 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.435927    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jul 20 15:56:24.436718 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.436691    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.436892 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.436876    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.676717 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.676691    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:24.676903 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:24.676881    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:27.436002 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:27.435966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:27.440963 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:27.440932    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:27.689451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:27.689367    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:56:27.692263 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:56:27.692237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:57:30.101778 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.101718    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:57:30.102485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.102049    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="registry" containerID="cri-o://d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e" gracePeriod=30
Jul 20 15:57:30.102485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.102099    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" containerID="cri-o://9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2" gracePeriod=30
Jul 20 15:57:30.102485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.102145    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="offline" containerID="cri-o://03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91" gracePeriod=30
Jul 20 15:57:30.102485 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.102100    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" containerID="cri-o://4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98" gracePeriod=30
Jul 20 15:57:30.557325 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.557288    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 15:57:30.561652 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.561627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.566494 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.566468    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4tkph\""
Jul 20 15:57:30.610699 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.610665    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 15:57:30.678608 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.678608 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.678857 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr22l\" (UniqueName: \"kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.678857 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.678857 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.678973 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.678858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779437 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779548 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779659 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:57:30.779558    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 15:57:30.779659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.779659 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:57:30.779630    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls podName:85ab812e-21ad-4bee-b351-a7c03935c9fd nodeName:}" failed. No retries permitted until 2026-07-20 15:57:31.279613304 +0000 UTC m=+1419.821340969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls") pod "feast-simple-feast-setup-777d6cc998-pv4l5" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 15:57:30.779659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.779652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr22l\" (UniqueName: \"kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.780057 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.780030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.782045 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.782016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.782125 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.782070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.782204 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.782188    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.790608 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.790585    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr22l\" (UniqueName: \"kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:30.921136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.921101    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98" exitCode=0
Jul 20 15:57:30.921136 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.921126    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2" exitCode=0
Jul 20 15:57:30.921322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.921168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"}
Jul 20 15:57:30.921322 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:30.921210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"}
Jul 20 15:57:31.283914 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.283876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:31.286166 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.286148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-pv4l5\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:31.471278 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.471239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:31.624185 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.624150    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 15:57:31.629921 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:57:31.629887    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85ab812e_21ad_4bee_b351_a7c03935c9fd.slice/crio-ff48a26a8e9df4e1501bccd09d8af8d5de77a0cb889c5eef427679f85c4252e4 WatchSource:0}: Error finding container ff48a26a8e9df4e1501bccd09d8af8d5de77a0cb889c5eef427679f85c4252e4: Status 404 returned error can't find the container with id ff48a26a8e9df4e1501bccd09d8af8d5de77a0cb889c5eef427679f85c4252e4
Jul 20 15:57:31.928305 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.928259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"}
Jul 20 15:57:31.928511 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:31.928319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"ff48a26a8e9df4e1501bccd09d8af8d5de77a0cb889c5eef427679f85c4252e4"}
Jul 20 15:57:36.951267 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:36.951234    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242" exitCode=0
Jul 20 15:57:36.951645 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:36.951307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"}
Jul 20 15:57:37.689838 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:37.689787    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jul 20 15:57:37.690006 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:37.689797    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jul 20 15:57:37.957513 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:37.957426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"}
Jul 20 15:57:42.980523 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:42.980487    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a" exitCode=0
Jul 20 15:57:42.980977 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:42.980563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"}
Jul 20 15:57:43.991272 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:43.991176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"}
Jul 20 15:57:43.991844 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:43.991811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"}
Jul 20 15:57:43.991844 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:43.991853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"}
Jul 20 15:57:43.992032 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:43.991874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerStarted","Data":"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"}
Jul 20 15:57:44.023285 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:44.023205    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podStartSLOduration=14.023180855 podStartE2EDuration="14.023180855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:57:44.019685447 +0000 UTC m=+1432.561413156" watchObservedRunningTime="2026-07-20 15:57:44.023180855 +0000 UTC m=+1432.564908541"
Jul 20 15:57:46.472084 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.472038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:46.472567 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.472105    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:46.472567 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.472539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:46.472681 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.472580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:46.474363 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.474327    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jul 20 15:57:46.474475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.474362    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 20 15:57:46.474475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.474406    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jul 20 15:57:46.474648 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:46.474616    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Jul 20 15:57:47.689833 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:47.689771    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jul 20 15:57:47.689833 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:47.689809    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jul 20 15:57:49.473148 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.473107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:49.473891 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.473378    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:49.473891 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.473709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:49.474147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.473912    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:49.474147 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.473963    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:49.478545 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:49.478523    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:50.022564 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:50.022532    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:50.022771 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:50.022580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:50.022771 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:50.022602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:50.023123 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:50.023104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:50.025761 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:50.025727    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:51.026763 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:51.026721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 15:57:57.689600 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:57.689561    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jul 20 15:57:57.689600 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:57.689599    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jul 20 15:57:57.690049 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:57.689684    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:57:57.690049 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:57:57.689730    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:58:00.745091 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.745068    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:58:00.833133 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833103    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833144    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzxvl\" (UniqueName: \"kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833177    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833200    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833306 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833503 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833312    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls\") pod \"69a01b69-4324-462f-a657-af1d4c94535c\" (UID: \"69a01b69-4324-462f-a657-af1d4c94535c\") "
Jul 20 15:58:00.833826 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.833794    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data" (OuterVolumeSpecName: "feast-data") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:58:00.835525 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.835497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:00.835620 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.835571    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl" (OuterVolumeSpecName: "kube-api-access-bzxvl") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "kube-api-access-bzxvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:58:00.835620 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.835579    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls" (OuterVolumeSpecName: "online-tls") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:00.835707 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.835640    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:00.835707 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.835700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "69a01b69-4324-462f-a657-af1d4c94535c" (UID: "69a01b69-4324-462f-a657-af1d4c94535c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934628    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934666    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934688    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzxvl\" (UniqueName: \"kubernetes.io/projected/69a01b69-4324-462f-a657-af1d4c94535c-kube-api-access-bzxvl\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934701    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/69a01b69-4324-462f-a657-af1d4c94535c-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934715    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:00.936595 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:00.934727    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/69a01b69-4324-462f-a657-af1d4c94535c-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 15:58:01.067044 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067013    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91" exitCode=137
Jul 20 15:58:01.067044 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067038    2558 generic.go:356] "Generic (PLEG): container finished" podID="69a01b69-4324-462f-a657-af1d4c94535c" containerID="d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e" exitCode=137
Jul 20 15:58:01.067254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067084    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"
Jul 20 15:58:01.067254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"}
Jul 20 15:58:01.067254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"}
Jul 20 15:58:01.067254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv" event={"ID":"69a01b69-4324-462f-a657-af1d4c94535c","Type":"ContainerDied","Data":"0703e96ff996e64e609eb83b6eb05515c91101d882d09b5d21f3b6bf4fbb189c"}
Jul 20 15:58:01.067254 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.067174    2558 scope.go:117] "RemoveContainer" containerID="4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"
Jul 20 15:58:01.076357 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.076344    2558 scope.go:117] "RemoveContainer" containerID="03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"
Jul 20 15:58:01.083569 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.083553    2558 scope.go:117] "RemoveContainer" containerID="9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"
Jul 20 15:58:01.091043 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.091026    2558 scope.go:117] "RemoveContainer" containerID="d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"
Jul 20 15:58:01.097954 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.097937    2558 scope.go:117] "RemoveContainer" containerID="b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"
Jul 20 15:58:01.104944 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.104921    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:58:01.105272 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.105255    2558 scope.go:117] "RemoveContainer" containerID="53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"
Jul 20 15:58:01.111978 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.111958    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pwghv"]
Jul 20 15:58:01.116475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.116456    2558 scope.go:117] "RemoveContainer" containerID="4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"
Jul 20 15:58:01.116726 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.116705    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98\": container with ID starting with 4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98 not found: ID does not exist" containerID="4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"
Jul 20 15:58:01.116824 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.116757    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"} err="failed to get container status \"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98\": rpc error: code = NotFound desc = could not find container \"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98\": container with ID starting with 4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98 not found: ID does not exist"
Jul 20 15:58:01.116824 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.116783    2558 scope.go:117] "RemoveContainer" containerID="03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"
Jul 20 15:58:01.117056 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.117039    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91\": container with ID starting with 03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91 not found: ID does not exist" containerID="03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"
Jul 20 15:58:01.117105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117061    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"} err="failed to get container status \"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91\": rpc error: code = NotFound desc = could not find container \"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91\": container with ID starting with 03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91 not found: ID does not exist"
Jul 20 15:58:01.117105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117077    2558 scope.go:117] "RemoveContainer" containerID="9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"
Jul 20 15:58:01.117306 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.117287    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2\": container with ID starting with 9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2 not found: ID does not exist" containerID="9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"
Jul 20 15:58:01.117346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117311    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"} err="failed to get container status \"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2\": rpc error: code = NotFound desc = could not find container \"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2\": container with ID starting with 9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2 not found: ID does not exist"
Jul 20 15:58:01.117346 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117325    2558 scope.go:117] "RemoveContainer" containerID="d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"
Jul 20 15:58:01.117545 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.117527    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e\": container with ID starting with d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e not found: ID does not exist" containerID="d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"
Jul 20 15:58:01.117587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117551    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"} err="failed to get container status \"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e\": rpc error: code = NotFound desc = could not find container \"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e\": container with ID starting with d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e not found: ID does not exist"
Jul 20 15:58:01.117587 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117565    2558 scope.go:117] "RemoveContainer" containerID="b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"
Jul 20 15:58:01.117804 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.117782    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b\": container with ID starting with b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b not found: ID does not exist" containerID="b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"
Jul 20 15:58:01.117901 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117808    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"} err="failed to get container status \"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b\": rpc error: code = NotFound desc = could not find container \"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b\": container with ID starting with b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b not found: ID does not exist"
Jul 20 15:58:01.117901 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.117829    2558 scope.go:117] "RemoveContainer" containerID="53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"
Jul 20 15:58:01.118055 ip-10-0-140-218 kubenswrapper[2558]: E0720 15:58:01.118041    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b\": container with ID starting with 53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b not found: ID does not exist" containerID="53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"
Jul 20 15:58:01.118099 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118057    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"} err="failed to get container status \"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b\": rpc error: code = NotFound desc = could not find container \"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b\": container with ID starting with 53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b not found: ID does not exist"
Jul 20 15:58:01.118099 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118077    2558 scope.go:117] "RemoveContainer" containerID="4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"
Jul 20 15:58:01.118302 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118284    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98"} err="failed to get container status \"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98\": rpc error: code = NotFound desc = could not find container \"4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98\": container with ID starting with 4ea409c28ade7ed6d290e9d8220616f9b61188b31d626bee044c2d4bcad00b98 not found: ID does not exist"
Jul 20 15:58:01.118377 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118304    2558 scope.go:117] "RemoveContainer" containerID="03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"
Jul 20 15:58:01.118523 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118507    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91"} err="failed to get container status \"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91\": rpc error: code = NotFound desc = could not find container \"03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91\": container with ID starting with 03b82d34477de2e4c840ea27c21c3d66eb70dc53e9eb0b8ed7269e73548dab91 not found: ID does not exist"
Jul 20 15:58:01.118585 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118524    2558 scope.go:117] "RemoveContainer" containerID="9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"
Jul 20 15:58:01.118761 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118728    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2"} err="failed to get container status \"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2\": rpc error: code = NotFound desc = could not find container \"9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2\": container with ID starting with 9d0b35218d380bd139822dd39abd69e1aba5137e0b2aab3fe7466bed05044ef2 not found: ID does not exist"
Jul 20 15:58:01.118811 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118767    2558 scope.go:117] "RemoveContainer" containerID="d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"
Jul 20 15:58:01.118972 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118955    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e"} err="failed to get container status \"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e\": rpc error: code = NotFound desc = could not find container \"d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e\": container with ID starting with d26a060fccfc0a097219019dec7a775c3c7dbea00c013507b3bc56f5c7ddcb6e not found: ID does not exist"
Jul 20 15:58:01.119015 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.118972    2558 scope.go:117] "RemoveContainer" containerID="b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"
Jul 20 15:58:01.119184 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.119166    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b"} err="failed to get container status \"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b\": rpc error: code = NotFound desc = could not find container \"b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b\": container with ID starting with b8e8ece6642db60286c7f1a196f63c72cd2c5eeef49dba07cb17097d0f4c3b9b not found: ID does not exist"
Jul 20 15:58:01.119240 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.119184    2558 scope.go:117] "RemoveContainer" containerID="53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"
Jul 20 15:58:01.119373 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:01.119358    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b"} err="failed to get container status \"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b\": rpc error: code = NotFound desc = could not find container \"53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b\": container with ID starting with 53b6987a5117e0d29197b4835e49dbd620ed8505290b90e5650844ffa583a26b not found: ID does not exist"
Jul 20 15:58:02.498419 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:02.498384    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a01b69-4324-462f-a657-af1d4c94535c" path="/var/lib/kubelet/pods/69a01b69-4324-462f-a657-af1d4c94535c/volumes"
Jul 20 15:58:54.319993 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.319957    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320330    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="offline"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320349    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="offline"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320366    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="registry"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320376    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="registry"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320408    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320416    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320429    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="feast-apply"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320437    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="feast-apply"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320447    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="feast-init"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320455    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="feast-init"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320466    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui"
Jul 20 15:58:54.320475 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320475    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui"
Jul 20 15:58:54.320966 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320569    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="ui"
Jul 20 15:58:54.320966 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320578    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="registry"
Jul 20 15:58:54.320966 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320585    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="online"
Jul 20 15:58:54.320966 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.320591    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a01b69-4324-462f-a657-af1d4c94535c" containerName="offline"
Jul 20 15:58:54.324545 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.324530    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.326565 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.326540    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-sk59x\""
Jul 20 15:58:54.326684 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.326637    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 15:58:54.326836 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.326819    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 15:58:54.326921 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.326884    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 15:58:54.327105 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.327089    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 15:58:54.327193 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.327162    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:58:54.327193 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.327162    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 15:58:54.335692 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.335670    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 15:58:54.439160 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxn4b\" (UniqueName: \"kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.439324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.439324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.439324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.439324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.439324 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.439281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540557 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxn4b\" (UniqueName: \"kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540557 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.540863 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.540817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.541035 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.541005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.541255 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.541228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.543208 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.543180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.543303 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.543286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.543345 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.543324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.548451 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.548434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxn4b\" (UniqueName: \"kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b\") pod \"feast-simple-feast-remote-setup-db6955c6c-t422j\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.635169 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.635127    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:58:54.765514 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:54.765447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 15:58:54.767827 ip-10-0-140-218 kubenswrapper[2558]: W0720 15:58:54.767801    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1b56a84_a1a9_47c0_99f6_71d139b9772d.slice/crio-4690d6b273989dc221e53212ed85ce51e684249890d9aa85d63a221880a20c03 WatchSource:0}: Error finding container 4690d6b273989dc221e53212ed85ce51e684249890d9aa85d63a221880a20c03: Status 404 returned error can't find the container with id 4690d6b273989dc221e53212ed85ce51e684249890d9aa85d63a221880a20c03
Jul 20 15:58:55.277169 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:55.277128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"ac6c4d9f8549de4b245cadeddd871515b9db98e72e08f7814ec8035e04299b63"}
Jul 20 15:58:55.277352 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:58:55.277176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"4690d6b273989dc221e53212ed85ce51e684249890d9aa85d63a221880a20c03"}
Jul 20 15:59:00.299890 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:00.299853    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerID="ac6c4d9f8549de4b245cadeddd871515b9db98e72e08f7814ec8035e04299b63" exitCode=0
Jul 20 15:59:00.300374 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:00.299908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"ac6c4d9f8549de4b245cadeddd871515b9db98e72e08f7814ec8035e04299b63"}
Jul 20 15:59:01.306344 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:01.306307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"893f314df2e6b2ea4ce1832302ab6457851b5ff9889b30b30bd42189132e401b"}
Jul 20 15:59:06.327126 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:06.327090    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerID="893f314df2e6b2ea4ce1832302ab6457851b5ff9889b30b30bd42189132e401b" exitCode=0
Jul 20 15:59:06.327544 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:06.327146    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"893f314df2e6b2ea4ce1832302ab6457851b5ff9889b30b30bd42189132e401b"}
Jul 20 15:59:07.336231 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:07.336195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"40124d92cc45296202151ed9ebf113b0c4cdb27cc0f3c263e5f422592c771880"}
Jul 20 15:59:07.336731 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:07.336244    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"09b4d3555a83b00016cbde20c32561f4c6899d11ef6d00f727ff022655aab6c7"}
Jul 20 15:59:07.336731 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:07.336258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerStarted","Data":"725622ce5ec8b8b08516cfbd5be3dabffc78963819ea845013acf04f8359fa89"}
Jul 20 15:59:07.361407 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:07.361341    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podStartSLOduration=13.361318226 podStartE2EDuration="13.361318226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:59:07.358842462 +0000 UTC m=+1515.900570147" watchObservedRunningTime="2026-07-20 15:59:07.361318226 +0000 UTC m=+1515.903045912"
Jul 20 15:59:09.635933 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.635895    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:09.636427 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.635954    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:09.636427 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.635974    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:09.638066 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.637946    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Jul 20 15:59:09.638066 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.637967    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jul 20 15:59:09.638066 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:09.638002    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jul 20 15:59:12.636978 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.636939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.637462 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.637061    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.637527 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.637457    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.637527 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.637493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.637684 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.637661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.637919 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.637900    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:12.643659 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:12.643641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:13.363843 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:13.363814    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 15:59:13.368487 ip-10-0-140-218 kubenswrapper[2558]: I0720 15:59:13.368461    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 16:00:15.580942 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.580897    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 16:00:15.581511 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.581140    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online" containerID="cri-o://725622ce5ec8b8b08516cfbd5be3dabffc78963819ea845013acf04f8359fa89" gracePeriod=30
Jul 20 16:00:15.581511 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.581212    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui" containerID="cri-o://40124d92cc45296202151ed9ebf113b0c4cdb27cc0f3c263e5f422592c771880" gracePeriod=30
Jul 20 16:00:15.581511 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.581207    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="offline" containerID="cri-o://09b4d3555a83b00016cbde20c32561f4c6899d11ef6d00f727ff022655aab6c7" gracePeriod=30
Jul 20 16:00:15.755097 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.755062    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 16:00:15.755358 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.755299    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="registry" containerID="cri-o://b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76" gracePeriod=30
Jul 20 16:00:15.755454 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.755353    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online" containerID="cri-o://3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09" gracePeriod=30
Jul 20 16:00:15.755454 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.755344    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui" containerID="cri-o://0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189" gracePeriod=30
Jul 20 16:00:15.755631 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:15.755600    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="offline" containerID="cri-o://f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e" gracePeriod=30
Jul 20 16:00:16.608520 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.608438    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189" exitCode=0
Jul 20 16:00:16.608520 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.608462    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09" exitCode=0
Jul 20 16:00:16.608520 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.608504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"}
Jul 20 16:00:16.608989 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.608546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"}
Jul 20 16:00:16.610940 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.610921    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerID="40124d92cc45296202151ed9ebf113b0c4cdb27cc0f3c263e5f422592c771880" exitCode=0
Jul 20 16:00:16.610940 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.610939    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerID="725622ce5ec8b8b08516cfbd5be3dabffc78963819ea845013acf04f8359fa89" exitCode=0
Jul 20 16:00:16.611022 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.610973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"40124d92cc45296202151ed9ebf113b0c4cdb27cc0f3c263e5f422592c771880"}
Jul 20 16:00:16.611022 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:16.610997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"725622ce5ec8b8b08516cfbd5be3dabffc78963819ea845013acf04f8359fa89"}
Jul 20 16:00:19.474053 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:19.474013    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jul 20 16:00:20.022904 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:20.022859    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 20 16:00:22.637797 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:22.637728    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jul 20 16:00:23.364862 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:23.364815    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jul 20 16:00:29.474196 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:29.474148    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jul 20 16:00:30.023679 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:30.023639    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 20 16:00:32.637771 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:32.637697    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jul 20 16:00:33.364426 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:33.364380    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jul 20 16:00:39.474213 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:39.474165    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jul 20 16:00:39.474700 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:39.474299    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 16:00:40.023700 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:40.023656    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jul 20 16:00:40.023940 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:40.023813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 16:00:42.638073 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:42.638029    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jul 20 16:00:42.638490 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:42.638150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 16:00:43.364024 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:43.363978    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jul 20 16:00:43.364204 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:43.364121    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 16:00:45.724354 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:45.724326    2558 generic.go:356] "Generic (PLEG): container finished" podID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerID="09b4d3555a83b00016cbde20c32561f4c6899d11ef6d00f727ff022655aab6c7" exitCode=137
Jul 20 16:00:45.724729 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:45.724379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"09b4d3555a83b00016cbde20c32561f4c6899d11ef6d00f727ff022655aab6c7"}
Jul 20 16:00:46.218638 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.218616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 16:00:46.287421 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287563 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287438    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287563 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287484    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287563 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287724 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287578    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287724 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287620    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxn4b\" (UniqueName: \"kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b\") pod \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\" (UID: \"d1b56a84-a1a9-47c0-99f6-71d139b9772d\") "
Jul 20 16:00:46.287999 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.287974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:00:46.288144 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.288119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data" (OuterVolumeSpecName: "feast-data") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:00:46.289788 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.289735    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.289788 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.289770    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b" (OuterVolumeSpecName: "kube-api-access-hxn4b") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "kube-api-access-hxn4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:00:46.290025 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.290007    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls" (OuterVolumeSpecName: "online-tls") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.290129 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.290098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d1b56a84-a1a9-47c0-99f6-71d139b9772d" (UID: "d1b56a84-a1a9-47c0-99f6-71d139b9772d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.389034 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389006    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b56a84-a1a9-47c0-99f6-71d139b9772d-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.389034 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389034    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1b56a84-a1a9-47c0-99f6-71d139b9772d-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.389227 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389044    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.389227 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389053    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxn4b\" (UniqueName: \"kubernetes.io/projected/d1b56a84-a1a9-47c0-99f6-71d139b9772d-kube-api-access-hxn4b\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.389227 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389063    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.389227 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.389071    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1b56a84-a1a9-47c0-99f6-71d139b9772d-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.403366 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.403339    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 16:00:46.489847 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.489816    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.489866    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.489902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.489943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr22l\" (UniqueName: \"kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.489983    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.490026    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") pod \"85ab812e-21ad-4bee-b351-a7c03935c9fd\" (UID: \"85ab812e-21ad-4bee-b351-a7c03935c9fd\") "
Jul 20 16:00:46.490502 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.490474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:00:46.492013 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.491981    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.492152 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.492013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.492152 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.492071    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.492266 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.492235    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l" (OuterVolumeSpecName: "kube-api-access-gr22l") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "kube-api-access-gr22l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:00:46.492396 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.492381    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "85ab812e-21ad-4bee-b351-a7c03935c9fd" (UID: "85ab812e-21ad-4bee-b351-a7c03935c9fd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:00:46.591224 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591193    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.591224 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591220    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.591224 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591228    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.591444 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591236    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab812e-21ad-4bee-b351-a7c03935c9fd-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.591444 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591244    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85ab812e-21ad-4bee-b351-a7c03935c9fd-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.591444 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.591253    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr22l\" (UniqueName: \"kubernetes.io/projected/85ab812e-21ad-4bee-b351-a7c03935c9fd-kube-api-access-gr22l\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:00:46.731391 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731307    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e" exitCode=137
Jul 20 16:00:46.731391 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731336    2558 generic.go:356] "Generic (PLEG): container finished" podID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerID="b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76" exitCode=137
Jul 20 16:00:46.731926 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731395    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"
Jul 20 16:00:46.731926 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"}
Jul 20 16:00:46.731926 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731510    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"}
Jul 20 16:00:46.731926 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731528    2558 scope.go:117] "RemoveContainer" containerID="0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"
Jul 20 16:00:46.731926 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.731534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5" event={"ID":"85ab812e-21ad-4bee-b351-a7c03935c9fd","Type":"ContainerDied","Data":"ff48a26a8e9df4e1501bccd09d8af8d5de77a0cb889c5eef427679f85c4252e4"}
Jul 20 16:00:46.734245 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.734220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j" event={"ID":"d1b56a84-a1a9-47c0-99f6-71d139b9772d","Type":"ContainerDied","Data":"4690d6b273989dc221e53212ed85ce51e684249890d9aa85d63a221880a20c03"}
Jul 20 16:00:46.734348 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.734270    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"
Jul 20 16:00:46.741365 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.741346    2558 scope.go:117] "RemoveContainer" containerID="f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"
Jul 20 16:00:46.748591 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.748528    2558 scope.go:117] "RemoveContainer" containerID="3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"
Jul 20 16:00:46.750606 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.750582    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 16:00:46.755281 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.755261    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-pv4l5"]
Jul 20 16:00:46.757339 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.757324    2558 scope.go:117] "RemoveContainer" containerID="b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"
Jul 20 16:00:46.764593 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.764533    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 16:00:46.764652 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.764624    2558 scope.go:117] "RemoveContainer" containerID="5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"
Jul 20 16:00:46.768799 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.768779    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-t422j"]
Jul 20 16:00:46.772044 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.772027    2558 scope.go:117] "RemoveContainer" containerID="7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"
Jul 20 16:00:46.779930 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.779916    2558 scope.go:117] "RemoveContainer" containerID="0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"
Jul 20 16:00:46.780165 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.780146    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189\": container with ID starting with 0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189 not found: ID does not exist" containerID="0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"
Jul 20 16:00:46.780230 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780174    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"} err="failed to get container status \"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189\": rpc error: code = NotFound desc = could not find container \"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189\": container with ID starting with 0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189 not found: ID does not exist"
Jul 20 16:00:46.780230 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780191    2558 scope.go:117] "RemoveContainer" containerID="f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"
Jul 20 16:00:46.780438 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.780422    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e\": container with ID starting with f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e not found: ID does not exist" containerID="f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"
Jul 20 16:00:46.780486 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780442    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"} err="failed to get container status \"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e\": rpc error: code = NotFound desc = could not find container \"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e\": container with ID starting with f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e not found: ID does not exist"
Jul 20 16:00:46.780486 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780455    2558 scope.go:117] "RemoveContainer" containerID="3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"
Jul 20 16:00:46.780696 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.780678    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09\": container with ID starting with 3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09 not found: ID does not exist" containerID="3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"
Jul 20 16:00:46.780735 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780706    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"} err="failed to get container status \"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09\": rpc error: code = NotFound desc = could not find container \"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09\": container with ID starting with 3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09 not found: ID does not exist"
Jul 20 16:00:46.780735 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780724    2558 scope.go:117] "RemoveContainer" containerID="b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"
Jul 20 16:00:46.780978 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.780954    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76\": container with ID starting with b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76 not found: ID does not exist" containerID="b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"
Jul 20 16:00:46.781019 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.780986    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"} err="failed to get container status \"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76\": rpc error: code = NotFound desc = could not find container \"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76\": container with ID starting with b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76 not found: ID does not exist"
Jul 20 16:00:46.781019 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781005    2558 scope.go:117] "RemoveContainer" containerID="5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"
Jul 20 16:00:46.781220 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.781205    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a\": container with ID starting with 5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a not found: ID does not exist" containerID="5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"
Jul 20 16:00:46.781264 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781224    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"} err="failed to get container status \"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a\": rpc error: code = NotFound desc = could not find container \"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a\": container with ID starting with 5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a not found: ID does not exist"
Jul 20 16:00:46.781264 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781236    2558 scope.go:117] "RemoveContainer" containerID="7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"
Jul 20 16:00:46.781443 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:00:46.781425    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242\": container with ID starting with 7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242 not found: ID does not exist" containerID="7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"
Jul 20 16:00:46.781495 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781444    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"} err="failed to get container status \"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242\": rpc error: code = NotFound desc = could not find container \"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242\": container with ID starting with 7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242 not found: ID does not exist"
Jul 20 16:00:46.781495 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781455    2558 scope.go:117] "RemoveContainer" containerID="0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"
Jul 20 16:00:46.781649 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781633    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189"} err="failed to get container status \"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189\": rpc error: code = NotFound desc = could not find container \"0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189\": container with ID starting with 0783bdc29430db04deb6f4d3519a12557073e2d9fdcc6c947b7982f4febfa189 not found: ID does not exist"
Jul 20 16:00:46.781694 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781648    2558 scope.go:117] "RemoveContainer" containerID="f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"
Jul 20 16:00:46.781837 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781821    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e"} err="failed to get container status \"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e\": rpc error: code = NotFound desc = could not find container \"f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e\": container with ID starting with f8481ce1e996ce495d4b177ee787cb3de745c97c0c6c44c00b9ec3843fabfa5e not found: ID does not exist"
Jul 20 16:00:46.781884 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781837    2558 scope.go:117] "RemoveContainer" containerID="3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"
Jul 20 16:00:46.782013 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.781995    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09"} err="failed to get container status \"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09\": rpc error: code = NotFound desc = could not find container \"3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09\": container with ID starting with 3b489683a5ca8f8894e1e8c5b0557857130d7d883b985f19281afa452cc8db09 not found: ID does not exist"
Jul 20 16:00:46.782055 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782012    2558 scope.go:117] "RemoveContainer" containerID="b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"
Jul 20 16:00:46.782214 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782199    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76"} err="failed to get container status \"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76\": rpc error: code = NotFound desc = could not find container \"b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76\": container with ID starting with b2983eb21064896aea00bf368b6772ea0ca3fa2d946ff629d80c3eebcb649c76 not found: ID does not exist"
Jul 20 16:00:46.782276 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782214    2558 scope.go:117] "RemoveContainer" containerID="5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"
Jul 20 16:00:46.782431 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782414    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a"} err="failed to get container status \"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a\": rpc error: code = NotFound desc = could not find container \"5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a\": container with ID starting with 5668b92423b4e8e0b8a908dcb175678f7fcd2fd6d79e254ccd8515445be6ea1a not found: ID does not exist"
Jul 20 16:00:46.782469 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782431    2558 scope.go:117] "RemoveContainer" containerID="7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"
Jul 20 16:00:46.782631 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782613    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242"} err="failed to get container status \"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242\": rpc error: code = NotFound desc = could not find container \"7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242\": container with ID starting with 7ef0b7682381336f90af7c1ce88d856fa126e3704df0054e9b91a0be701c1242 not found: ID does not exist"
Jul 20 16:00:46.782676 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.782633    2558 scope.go:117] "RemoveContainer" containerID="40124d92cc45296202151ed9ebf113b0c4cdb27cc0f3c263e5f422592c771880"
Jul 20 16:00:46.789890 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.789875    2558 scope.go:117] "RemoveContainer" containerID="09b4d3555a83b00016cbde20c32561f4c6899d11ef6d00f727ff022655aab6c7"
Jul 20 16:00:46.796546 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.796529    2558 scope.go:117] "RemoveContainer" containerID="725622ce5ec8b8b08516cfbd5be3dabffc78963819ea845013acf04f8359fa89"
Jul 20 16:00:46.803411 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.803395    2558 scope.go:117] "RemoveContainer" containerID="893f314df2e6b2ea4ce1832302ab6457851b5ff9889b30b30bd42189132e401b"
Jul 20 16:00:46.810036 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:46.810021    2558 scope.go:117] "RemoveContainer" containerID="ac6c4d9f8549de4b245cadeddd871515b9db98e72e08f7814ec8035e04299b63"
Jul 20 16:00:48.498456 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:48.498423    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" path="/var/lib/kubelet/pods/85ab812e-21ad-4bee-b351-a7c03935c9fd/volumes"
Jul 20 16:00:48.499049 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:00:48.499034    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" path="/var/lib/kubelet/pods/d1b56a84-a1a9-47c0-99f6-71d139b9772d/volumes"
Jul 20 16:01:26.917433 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917400    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917691    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917701    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917714    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="registry"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917720    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="registry"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917733    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917740    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917761    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="offline"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917768    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="offline"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917776    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917781    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917789    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="feast-apply"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917795    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="feast-apply"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917799    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="offline"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917804    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="offline"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="feast-init"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917815    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="feast-init"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917821    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="feast-init"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917827    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="feast-init"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917832    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917836    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917846    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="feast-apply"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917854    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="feast-apply"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917918    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="offline"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917926    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="online"
Jul 20 16:01:26.917922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917933    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="ui"
Jul 20 16:01:26.918736 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917940    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="online"
Jul 20 16:01:26.918736 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917945    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b56a84-a1a9-47c0-99f6-71d139b9772d" containerName="offline"
Jul 20 16:01:26.918736 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917951    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="registry"
Jul 20 16:01:26.918736 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.917956    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab812e-21ad-4bee-b351-a7c03935c9fd" containerName="ui"
Jul 20 16:01:26.921221 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.921204    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:26.926268 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.926237    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 16:01:26.926682 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.926655    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 16:01:26.926889 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.926864    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6zbsl\""
Jul 20 16:01:26.926889 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.926881    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 16:01:26.927063 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.927024    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 16:01:26.927131 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.927070    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 16:01:26.927244 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.927224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 16:01:26.940633 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:26.940610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:01:27.102458 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.102633 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102479    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.102633 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.102633 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.102770 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.102770 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.102675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whznr\" (UniqueName: \"kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203132 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whznr\" (UniqueName: \"kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203132 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203316 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203316 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203398 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203398 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.203561 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.203541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.205658 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.205631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.205842 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.205823    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.205913 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.205846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.205954 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.205942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.211843 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.211822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whznr\" (UniqueName: \"kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr\") pod \"feast-simple-feast-setup-777d6cc998-tqhbs\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.242565 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.242540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:27.379528 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.379503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:01:27.381313 ip-10-0-140-218 kubenswrapper[2558]: W0720 16:01:27.381286    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod287b3536_716f_457e_b5a4_9e842c3ed288.slice/crio-0d0e7a35311813c69a24da873f2ffafbfb4927c608582b7b00d2bce369c8e1ee WatchSource:0}: Error finding container 0d0e7a35311813c69a24da873f2ffafbfb4927c608582b7b00d2bce369c8e1ee: Status 404 returned error can't find the container with id 0d0e7a35311813c69a24da873f2ffafbfb4927c608582b7b00d2bce369c8e1ee
Jul 20 16:01:27.891629 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.891589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"125aec78fad7ed0a2069a32ddfdaaeaeaefa5d7879b13f52d4c3c40a70f5ff64"}
Jul 20 16:01:27.891820 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:27.891650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"0d0e7a35311813c69a24da873f2ffafbfb4927c608582b7b00d2bce369c8e1ee"}
Jul 20 16:01:32.910911 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:32.910875    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="125aec78fad7ed0a2069a32ddfdaaeaeaefa5d7879b13f52d4c3c40a70f5ff64" exitCode=0
Jul 20 16:01:32.911410 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:32.910937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"125aec78fad7ed0a2069a32ddfdaaeaeaefa5d7879b13f52d4c3c40a70f5ff64"}
Jul 20 16:01:33.916450 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:33.916412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"6d1f94b0e70496a2c877841db63bdf2dfa32a0ac6ffdfd020b2ca3c71a20744a"}
Jul 20 16:01:38.937237 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:38.937204    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="6d1f94b0e70496a2c877841db63bdf2dfa32a0ac6ffdfd020b2ca3c71a20744a" exitCode=0
Jul 20 16:01:38.937626 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:38.937278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"6d1f94b0e70496a2c877841db63bdf2dfa32a0ac6ffdfd020b2ca3c71a20744a"}
Jul 20 16:01:39.947819 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:39.947773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"19a391ee35782b172165f23c3db07a36174ccfcad91b4eb9bff043a1768a031a"}
Jul 20 16:01:39.948310 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:39.947843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"ec05fdbc258a599d63ec3667f3b11d20b7026e0d00e0c513b24a48ab77714f91"}
Jul 20 16:01:39.948310 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:39.947865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"066b3b434640e7037e070e8337e28cd74508ef3971751e441867c405317e4439"}
Jul 20 16:01:39.948310 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:39.947883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerStarted","Data":"8712eea1b3bff179e44a9f492f54dae6ac6c0b614e44acee56438563b96c8bdd"}
Jul 20 16:01:39.978472 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:39.978399    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podStartSLOduration=13.978379459 podStartE2EDuration="13.978379459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:01:39.976908167 +0000 UTC m=+1668.518635880" watchObservedRunningTime="2026-07-20 16:01:39.978379459 +0000 UTC m=+1668.520107144"
Jul 20 16:01:42.243774 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.243720    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:42.244408 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.244379    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:42.244541 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.244416    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:42.244541 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.244437    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:42.246058 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.245955    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Jul 20 16:01:42.246058 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.245993    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Jul 20 16:01:42.246058 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.246005    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused"
Jul 20 16:01:42.246304 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:42.246126    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Jul 20 16:01:45.243913 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.243878    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244344 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244344 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244205    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244592 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244568    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244810 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244789    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244925 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244818    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.244925 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244884    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.245041 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.244930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.245041 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.245019    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.249133 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.249116    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.982534 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.982498    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:01:45.985707 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:01:45.985680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:02:48.138303 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.138208    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:02:48.138877 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.138439    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="registry" containerID="cri-o://8712eea1b3bff179e44a9f492f54dae6ac6c0b614e44acee56438563b96c8bdd" gracePeriod=30
Jul 20 16:02:48.138877 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.138521    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="offline" containerID="cri-o://ec05fdbc258a599d63ec3667f3b11d20b7026e0d00e0c513b24a48ab77714f91" gracePeriod=30
Jul 20 16:02:48.138877 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.138515    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui" containerID="cri-o://19a391ee35782b172165f23c3db07a36174ccfcad91b4eb9bff043a1768a031a" gracePeriod=30
Jul 20 16:02:48.138877 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.138527    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online" containerID="cri-o://066b3b434640e7037e070e8337e28cd74508ef3971751e441867c405317e4439" gracePeriod=30
Jul 20 16:02:48.421217 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.421128    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:02:48.424901 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.424882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.426909 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:02:48.426869    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"feast-simple-feast-setup-777d6cc998-5r4fz\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.426909 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:02:48.426891    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"feast-simple-feast-setup-dockercfg-rlq9c\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"test-ns-feast\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rlq9c\"" type="*v1.Secret"
Jul 20 16:02:48.434038 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.434155 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.434227 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.434296 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.434352 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.434352 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.434324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkcc7\" (UniqueName: \"kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.446059 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.446033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:02:48.535188 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkcc7\" (UniqueName: \"kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:02:48.535308    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535400 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.535368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.535720 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:02:48.535407    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls podName:a9f4b257-146d-4bb4-b7ff-7c88a6e1f933 nodeName:}" failed. No retries permitted until 2026-07-20 16:02:49.035385309 +0000 UTC m=+1737.577112983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls") pod "feast-simple-feast-setup-777d6cc998-5r4fz" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 20 16:02:48.536081 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.536051    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.538103 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.538068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.538270 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.538248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.538925 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.538901    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:48.553582 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:48.553553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkcc7\" (UniqueName: \"kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:49.039743 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.039650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:49.042062 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.042032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-5r4fz\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:49.219276 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.219243    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="19a391ee35782b172165f23c3db07a36174ccfcad91b4eb9bff043a1768a031a" exitCode=0
Jul 20 16:02:49.219276 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.219269    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="066b3b434640e7037e070e8337e28cd74508ef3971751e441867c405317e4439" exitCode=0
Jul 20 16:02:49.219684 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.219313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"19a391ee35782b172165f23c3db07a36174ccfcad91b4eb9bff043a1768a031a"}
Jul 20 16:02:49.219684 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.219351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"066b3b434640e7037e070e8337e28cd74508ef3971751e441867c405317e4439"}
Jul 20 16:02:49.984712 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.984683    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rlq9c\""
Jul 20 16:02:49.985790 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:49.985763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:02:50.115402 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:50.115373    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:02:50.117399 ip-10-0-140-218 kubenswrapper[2558]: W0720 16:02:50.117365    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9f4b257_146d_4bb4_b7ff_7c88a6e1f933.slice/crio-5f743d1cc9c91e28ff5ac025235f9c71aa79387b38d1d3dd895519adb7839b68 WatchSource:0}: Error finding container 5f743d1cc9c91e28ff5ac025235f9c71aa79387b38d1d3dd895519adb7839b68: Status 404 returned error can't find the container with id 5f743d1cc9c91e28ff5ac025235f9c71aa79387b38d1d3dd895519adb7839b68
Jul 20 16:02:50.225509 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:50.225470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"e7e96e0e7e686cdf6d5cd2ff8767c43871e663920b22fbe235490908e42b6f34"}
Jul 20 16:02:50.225927 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:50.225522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"5f743d1cc9c91e28ff5ac025235f9c71aa79387b38d1d3dd895519adb7839b68"}
Jul 20 16:02:55.244853 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:55.244809    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Jul 20 16:02:55.246173 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:55.246147    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="e7e96e0e7e686cdf6d5cd2ff8767c43871e663920b22fbe235490908e42b6f34" exitCode=0
Jul 20 16:02:55.246275 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:55.246190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"e7e96e0e7e686cdf6d5cd2ff8767c43871e663920b22fbe235490908e42b6f34"}
Jul 20 16:02:55.983769 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:55.983695    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Jul 20 16:02:56.253101 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:02:56.253007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"a7368d84c82d3b57cf6c020e1882091cf2da61a3494e8c92fac9e543df52cd06"}
Jul 20 16:03:01.276908 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:01.276871    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="a7368d84c82d3b57cf6c020e1882091cf2da61a3494e8c92fac9e543df52cd06" exitCode=0
Jul 20 16:03:01.277291 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:01.276939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"a7368d84c82d3b57cf6c020e1882091cf2da61a3494e8c92fac9e543df52cd06"}
Jul 20 16:03:02.287011 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:02.286967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"5f922198082e12420d10012a39afe52a59b4b780fb2d8e07bf7da6b1114fda08"}
Jul 20 16:03:02.287504 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:02.287034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"61655ca4e75d533a752a815137fb1cdbbd0afa0030e88e556429500ca46e1253"}
Jul 20 16:03:02.287504 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:02.287056    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"8a267c69ab9bb41d3c8f5e632174ad6e8cc1e21c94359befe0aead39db4cc8a7"}
Jul 20 16:03:02.287504 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:02.287074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerStarted","Data":"861eb40fd7430001fd53b0d8ce008bae9140c108d16712b33eb8b296e856dbf8"}
Jul 20 16:03:02.313461 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:02.313358    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podStartSLOduration=14.313335349 podStartE2EDuration="14.313335349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:03:02.311352821 +0000 UTC m=+1750.853080530" watchObservedRunningTime="2026-07-20 16:03:02.313335349 +0000 UTC m=+1750.855063038"
Jul 20 16:03:04.986065 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.986029    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:04.986685 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.986648    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:04.986685 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.986686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:04.986922 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.986704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:04.988023 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.987983    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Jul 20 16:03:04.988157 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.988008    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jul 20 16:03:04.988157 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.988033    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 20 16:03:04.988157 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:04.988090    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Jul 20 16:03:05.244934 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:05.244830    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Jul 20 16:03:05.983561 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:05.983502    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Jul 20 16:03:07.987591 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.987554    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.988104 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.987915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.988104 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.988069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.988441 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.988416    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.988572 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.988465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.988572 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.988481    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.989006 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.988985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.989088 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.989035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.989088 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.989072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:07.992841 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:07.992820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:08.318121 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:08.318043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:08.321350 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:08.321324    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:03:15.245540 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:15.245490    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Jul 20 16:03:15.246064 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:15.245634    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:03:15.983304 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:15.983263    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Jul 20 16:03:15.983580 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:15.983387    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:03:18.361340 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.361309    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="ec05fdbc258a599d63ec3667f3b11d20b7026e0d00e0c513b24a48ab77714f91" exitCode=137
Jul 20 16:03:18.361340 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.361334    2558 generic.go:356] "Generic (PLEG): container finished" podID="287b3536-716f-457e-b5a4-9e842c3ed288" containerID="8712eea1b3bff179e44a9f492f54dae6ac6c0b614e44acee56438563b96c8bdd" exitCode=137
Jul 20 16:03:18.361776 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.361378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"ec05fdbc258a599d63ec3667f3b11d20b7026e0d00e0c513b24a48ab77714f91"}
Jul 20 16:03:18.361776 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.361418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"8712eea1b3bff179e44a9f492f54dae6ac6c0b614e44acee56438563b96c8bdd"}
Jul 20 16:03:18.791625 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.791601    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:03:18.889542 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889507    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.889805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889557    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whznr\" (UniqueName: \"kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.889805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889596    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.889805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889616    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.889805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889634    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.889805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.889669    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls\") pod \"287b3536-716f-457e-b5a4-9e842c3ed288\" (UID: \"287b3536-716f-457e-b5a4-9e842c3ed288\") "
Jul 20 16:03:18.890216 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.890185    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data" (OuterVolumeSpecName: "feast-data") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:03:18.891975 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.891948    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:18.892077 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.891972    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:18.892077 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.892053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr" (OuterVolumeSpecName: "kube-api-access-whznr") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "kube-api-access-whznr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:03:18.892171 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.892154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls" (OuterVolumeSpecName: "online-tls") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:18.892212 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.892174    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "287b3536-716f-457e-b5a4-9e842c3ed288" (UID: "287b3536-716f-457e-b5a4-9e842c3ed288"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990690    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990733    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990770    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whznr\" (UniqueName: \"kubernetes.io/projected/287b3536-716f-457e-b5a4-9e842c3ed288-kube-api-access-whznr\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990783    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/287b3536-716f-457e-b5a4-9e842c3ed288-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990792    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:18.990822 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:18.990800    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/287b3536-716f-457e-b5a4-9e842c3ed288-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:03:19.367855 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.367773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs" event={"ID":"287b3536-716f-457e-b5a4-9e842c3ed288","Type":"ContainerDied","Data":"0d0e7a35311813c69a24da873f2ffafbfb4927c608582b7b00d2bce369c8e1ee"}
Jul 20 16:03:19.367855 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.367827    2558 scope.go:117] "RemoveContainer" containerID="19a391ee35782b172165f23c3db07a36174ccfcad91b4eb9bff043a1768a031a"
Jul 20 16:03:19.368288 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.367782    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"
Jul 20 16:03:19.377102 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.377085    2558 scope.go:117] "RemoveContainer" containerID="ec05fdbc258a599d63ec3667f3b11d20b7026e0d00e0c513b24a48ab77714f91"
Jul 20 16:03:19.384383 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.384359    2558 scope.go:117] "RemoveContainer" containerID="066b3b434640e7037e070e8337e28cd74508ef3971751e441867c405317e4439"
Jul 20 16:03:19.390195 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.390174    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:03:19.391438 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.391426    2558 scope.go:117] "RemoveContainer" containerID="8712eea1b3bff179e44a9f492f54dae6ac6c0b614e44acee56438563b96c8bdd"
Jul 20 16:03:19.395424 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.395405    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tqhbs"]
Jul 20 16:03:19.398734 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.398720    2558 scope.go:117] "RemoveContainer" containerID="6d1f94b0e70496a2c877841db63bdf2dfa32a0ac6ffdfd020b2ca3c71a20744a"
Jul 20 16:03:19.405436 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:19.405421    2558 scope.go:117] "RemoveContainer" containerID="125aec78fad7ed0a2069a32ddfdaaeaeaefa5d7879b13f52d4c3c40a70f5ff64"
Jul 20 16:03:20.498302 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:03:20.498266    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" path="/var/lib/kubelet/pods/287b3536-716f-457e-b5a4-9e842c3ed288/volumes"
Jul 20 16:04:10.287430 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287391    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287820    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="feast-init"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287839    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="feast-init"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287860    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287869    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287880    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="registry"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287888    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="registry"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287916    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="feast-apply"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287922    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="feast-apply"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287928    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="offline"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287933    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="offline"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287945    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.287950    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.288011    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="offline"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.288020    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="ui"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.288025    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="online"
Jul 20 16:04:10.289692 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.288033    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="287b3536-716f-457e-b5a4-9e842c3ed288" containerName="registry"
Jul 20 16:04:10.290939 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.290921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.296939 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.296911    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 16:04:10.297071 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.296919    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 16:04:10.297071 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.296923    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 16:04:10.297317 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.297300    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 16:04:10.297413 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.297316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 16:04:10.297413 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.297305    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 16:04:10.297413 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.297381    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-kmmmg\""
Jul 20 16:04:10.311373 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.311348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:04:10.379166 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.379318 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.379318 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.379318 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.379429 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tw56\" (UniqueName: \"kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.379429 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.379390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480024 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.479993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480199 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480199 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tw56\" (UniqueName: \"kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480199 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480199 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480199 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480580 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.480869 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.480848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.482623 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.482605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.482740 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.482723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.482805 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.482773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.491873 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.491855    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tw56\" (UniqueName: \"kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56\") pod \"feast-simple-feast-remote-setup-db6955c6c-pdf2c\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.600458 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.600384    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:10.733937 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:10.733884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:04:10.736186 ip-10-0-140-218 kubenswrapper[2558]: W0720 16:04:10.736153    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc3bacb6_5ee5_43d4_bf6e_23596777dbea.slice/crio-b034e4872c1c4a260741559fdc4784aa010715f2818a62a2424a7ad96dbb5072 WatchSource:0}: Error finding container b034e4872c1c4a260741559fdc4784aa010715f2818a62a2424a7ad96dbb5072: Status 404 returned error can't find the container with id b034e4872c1c4a260741559fdc4784aa010715f2818a62a2424a7ad96dbb5072
Jul 20 16:04:11.563734 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:11.563694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"fc9aafdd0c481286029ed576f1c246de074520594e4ccd43473e438ba0463a92"}
Jul 20 16:04:11.564158 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:11.563774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"b034e4872c1c4a260741559fdc4784aa010715f2818a62a2424a7ad96dbb5072"}
Jul 20 16:04:15.579886 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:15.579852    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerID="fc9aafdd0c481286029ed576f1c246de074520594e4ccd43473e438ba0463a92" exitCode=0
Jul 20 16:04:15.580406 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:15.579905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"fc9aafdd0c481286029ed576f1c246de074520594e4ccd43473e438ba0463a92"}
Jul 20 16:04:16.586203 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:16.586166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"d7542b29712052e33c6af29826f440124a863be5876dc8f7a618e440b161d702"}
Jul 20 16:04:21.607624 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:21.607588    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerID="d7542b29712052e33c6af29826f440124a863be5876dc8f7a618e440b161d702" exitCode=0
Jul 20 16:04:21.608060 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:21.607647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"d7542b29712052e33c6af29826f440124a863be5876dc8f7a618e440b161d702"}
Jul 20 16:04:22.614827 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:22.614788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"ecc60e52083124424d0cc317bb21c50fb0035945c1094fd0cd5ff102e94ad074"}
Jul 20 16:04:22.615212 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:22.614854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"112974aac00a02849c8cb0458a172f45fff2f270ca00d0103294477759f24120"}
Jul 20 16:04:22.615212 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:22.614877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerStarted","Data":"fd78ee0aaeaf041a4e9fe388c5d7cd12ec0b0b4def24bc6b2abc710b6bb41fee"}
Jul 20 16:04:22.640013 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:22.639950    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podStartSLOduration=12.639928864 podStartE2EDuration="12.639928864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:22.637394869 +0000 UTC m=+1831.179122555" watchObservedRunningTime="2026-07-20 16:04:22.639928864 +0000 UTC m=+1831.181656548"
Jul 20 16:04:25.601421 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.601380    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:25.602008 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.601985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:25.602149 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.602135    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:25.603088 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.603049    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Jul 20 16:04:25.603203 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.603094    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Jul 20 16:04:25.603203 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:25.603108    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 20 16:04:28.601467 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.601432    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.601924 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.601609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.602129 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.602104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.602263 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.602159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.602263 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.602255    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.602543 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.602527    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.608052 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.608033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.645432 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.645401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:04:28.649460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:04:28.649440    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:05:29.416823 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.416732    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:05:29.417331 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.416962    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online" containerID="cri-o://fd78ee0aaeaf041a4e9fe388c5d7cd12ec0b0b4def24bc6b2abc710b6bb41fee" gracePeriod=30
Jul 20 16:05:29.417331 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.417019    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="offline" containerID="cri-o://112974aac00a02849c8cb0458a172f45fff2f270ca00d0103294477759f24120" gracePeriod=30
Jul 20 16:05:29.417331 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.417012    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui" containerID="cri-o://ecc60e52083124424d0cc317bb21c50fb0035945c1094fd0cd5ff102e94ad074" gracePeriod=30
Jul 20 16:05:29.576921 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.576887    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:05:29.577123 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.577102    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="registry" containerID="cri-o://861eb40fd7430001fd53b0d8ce008bae9140c108d16712b33eb8b296e856dbf8" gracePeriod=30
Jul 20 16:05:29.577254 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.577221    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="offline" containerID="cri-o://61655ca4e75d533a752a815137fb1cdbbd0afa0030e88e556429500ca46e1253" gracePeriod=30
Jul 20 16:05:29.577345 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.577244    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui" containerID="cri-o://5f922198082e12420d10012a39afe52a59b4b780fb2d8e07bf7da6b1114fda08" gracePeriod=30
Jul 20 16:05:29.577345 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:29.577239    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online" containerID="cri-o://8a267c69ab9bb41d3c8f5e632174ad6e8cc1e21c94359befe0aead39db4cc8a7" gracePeriod=30
Jul 20 16:05:30.885242 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.885205    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="5f922198082e12420d10012a39afe52a59b4b780fb2d8e07bf7da6b1114fda08" exitCode=0
Jul 20 16:05:30.885242 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.885233    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="8a267c69ab9bb41d3c8f5e632174ad6e8cc1e21c94359befe0aead39db4cc8a7" exitCode=0
Jul 20 16:05:30.885724 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.885275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"5f922198082e12420d10012a39afe52a59b4b780fb2d8e07bf7da6b1114fda08"}
Jul 20 16:05:30.885724 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.885323    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"8a267c69ab9bb41d3c8f5e632174ad6e8cc1e21c94359befe0aead39db4cc8a7"}
Jul 20 16:05:30.887880 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.887855    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerID="ecc60e52083124424d0cc317bb21c50fb0035945c1094fd0cd5ff102e94ad074" exitCode=0
Jul 20 16:05:30.887880 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.887877    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerID="fd78ee0aaeaf041a4e9fe388c5d7cd12ec0b0b4def24bc6b2abc710b6bb41fee" exitCode=0
Jul 20 16:05:30.888015 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.887903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"ecc60e52083124424d0cc317bb21c50fb0035945c1094fd0cd5ff102e94ad074"}
Jul 20 16:05:30.888015 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:30.887937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"fd78ee0aaeaf041a4e9fe388c5d7cd12ec0b0b4def24bc6b2abc710b6bb41fee"}
Jul 20 16:05:37.989181 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:37.989122    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Jul 20 16:05:38.318905 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:38.318814    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 20 16:05:38.602368 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:38.602269    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Jul 20 16:05:38.645732 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:38.645701    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 20 16:05:47.988893 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:47.988839    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Jul 20 16:05:48.319048 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:48.318947    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 20 16:05:48.602942 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:48.602837    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Jul 20 16:05:48.646586 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:48.646544    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 20 16:05:57.989129 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:57.989081    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Jul 20 16:05:57.989720 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:57.989231    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:05:58.318772 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.318654    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jul 20 16:05:58.318936 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.318809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:05:58.602852 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.602731    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Jul 20 16:05:58.603009 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.602882    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:05:58.646434 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.646391    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jul 20 16:05:58.646599 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:05:58.646500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:06:00.000590 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.000551    2558 generic.go:356] "Generic (PLEG): container finished" podID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerID="112974aac00a02849c8cb0458a172f45fff2f270ca00d0103294477759f24120" exitCode=137
Jul 20 16:06:00.001032 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.000627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"112974aac00a02849c8cb0458a172f45fff2f270ca00d0103294477759f24120"}
Jul 20 16:06:00.004466 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.004436    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="61655ca4e75d533a752a815137fb1cdbbd0afa0030e88e556429500ca46e1253" exitCode=137
Jul 20 16:06:00.004466 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.004467    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerID="861eb40fd7430001fd53b0d8ce008bae9140c108d16712b33eb8b296e856dbf8" exitCode=137
Jul 20 16:06:00.004621 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.004466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"61655ca4e75d533a752a815137fb1cdbbd0afa0030e88e556429500ca46e1253"}
Jul 20 16:06:00.004621 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.004503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"861eb40fd7430001fd53b0d8ce008bae9140c108d16712b33eb8b296e856dbf8"}
Jul 20 16:06:00.055795 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.055771    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:06:00.094767 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.094724    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.094901 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.094793    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.094901 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.094852    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.095098 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.094956    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.095098 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.095001    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.095098 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.095028    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tw56\" (UniqueName: \"kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56\") pod \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\" (UID: \"bc3bacb6-5ee5-43d4-bf6e-23596777dbea\") "
Jul 20 16:06:00.095389 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.095232    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:06:00.095389 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.095270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data" (OuterVolumeSpecName: "feast-data") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:06:00.097108 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.097079    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls" (OuterVolumeSpecName: "online-tls") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.097210 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.097154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.097392 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.097374    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56" (OuterVolumeSpecName: "kube-api-access-8tw56") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "kube-api-access-8tw56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:06:00.097455 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.097385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bc3bacb6-5ee5-43d4-bf6e-23596777dbea" (UID: "bc3bacb6-5ee5-43d4-bf6e-23596777dbea"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196383    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196413    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196423    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196431    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196440    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tw56\" (UniqueName: \"kubernetes.io/projected/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-kube-api-access-8tw56\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.196460 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.196450    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc3bacb6-5ee5-43d4-bf6e-23596777dbea-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.215545 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.215521    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:06:00.297604 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkcc7\" (UniqueName: \"kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.297604 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297611    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.297836 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297632    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.297836 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297657    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.297836 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.297836 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.297768    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls\") pod \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\" (UID: \"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933\") "
Jul 20 16:06:00.298265 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.298231    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data" (OuterVolumeSpecName: "feast-data") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:06:00.299960 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.299930    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls" (OuterVolumeSpecName: "online-tls") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.300061 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.299941    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.300061 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.299966    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.300315 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.300300    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:00.300357 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.300311    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7" (OuterVolumeSpecName: "kube-api-access-nkcc7") pod "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" (UID: "a9f4b257-146d-4bb4-b7ff-7c88a6e1f933"). InnerVolumeSpecName "kube-api-access-nkcc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:06:00.398586 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398555    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-registry-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.398586 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398583    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-online-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.398586 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398594    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkcc7\" (UniqueName: \"kubernetes.io/projected/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-kube-api-access-nkcc7\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.398848 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398602    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-offline-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.398848 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398610    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-feast-data\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:00.398848 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:00.398618    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933-ui-tls\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:01.011014 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.010986    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"
Jul 20 16:06:01.011014 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.010998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz" event={"ID":"a9f4b257-146d-4bb4-b7ff-7c88a6e1f933","Type":"ContainerDied","Data":"5f743d1cc9c91e28ff5ac025235f9c71aa79387b38d1d3dd895519adb7839b68"}
Jul 20 16:06:01.011505 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.011052    2558 scope.go:117] "RemoveContainer" containerID="5f922198082e12420d10012a39afe52a59b4b780fb2d8e07bf7da6b1114fda08"
Jul 20 16:06:01.013680 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.013654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c" event={"ID":"bc3bacb6-5ee5-43d4-bf6e-23596777dbea","Type":"ContainerDied","Data":"b034e4872c1c4a260741559fdc4784aa010715f2818a62a2424a7ad96dbb5072"}
Jul 20 16:06:01.013803 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.013724    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"
Jul 20 16:06:01.020382 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.020365    2558 scope.go:117] "RemoveContainer" containerID="61655ca4e75d533a752a815137fb1cdbbd0afa0030e88e556429500ca46e1253"
Jul 20 16:06:01.029268 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.028128    2558 scope.go:117] "RemoveContainer" containerID="8a267c69ab9bb41d3c8f5e632174ad6e8cc1e21c94359befe0aead39db4cc8a7"
Jul 20 16:06:01.032375 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.032354    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:06:01.037074 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.037056    2558 scope.go:117] "RemoveContainer" containerID="861eb40fd7430001fd53b0d8ce008bae9140c108d16712b33eb8b296e856dbf8"
Jul 20 16:06:01.037279 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.037260    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-5r4fz"]
Jul 20 16:06:01.044283 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.044268    2558 scope.go:117] "RemoveContainer" containerID="a7368d84c82d3b57cf6c020e1882091cf2da61a3494e8c92fac9e543df52cd06"
Jul 20 16:06:01.046829 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.046808    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:06:01.050618 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.050597    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pdf2c"]
Jul 20 16:06:01.051935 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.051919    2558 scope.go:117] "RemoveContainer" containerID="e7e96e0e7e686cdf6d5cd2ff8767c43871e663920b22fbe235490908e42b6f34"
Jul 20 16:06:01.058867 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.058848    2558 scope.go:117] "RemoveContainer" containerID="ecc60e52083124424d0cc317bb21c50fb0035945c1094fd0cd5ff102e94ad074"
Jul 20 16:06:01.065836 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.065821    2558 scope.go:117] "RemoveContainer" containerID="112974aac00a02849c8cb0458a172f45fff2f270ca00d0103294477759f24120"
Jul 20 16:06:01.072816 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.072798    2558 scope.go:117] "RemoveContainer" containerID="fd78ee0aaeaf041a4e9fe388c5d7cd12ec0b0b4def24bc6b2abc710b6bb41fee"
Jul 20 16:06:01.079497 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.079482    2558 scope.go:117] "RemoveContainer" containerID="d7542b29712052e33c6af29826f440124a863be5876dc8f7a618e440b161d702"
Jul 20 16:06:01.085827 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:01.085812    2558 scope.go:117] "RemoveContainer" containerID="fc9aafdd0c481286029ed576f1c246de074520594e4ccd43473e438ba0463a92"
Jul 20 16:06:02.498331 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:02.498291    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" path="/var/lib/kubelet/pods/a9f4b257-146d-4bb4-b7ff-7c88a6e1f933/volumes"
Jul 20 16:06:02.499132 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:02.499110    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" path="/var/lib/kubelet/pods/bc3bacb6-5ee5-43d4-bf6e-23596777dbea/volumes"
Jul 20 16:06:19.121520 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121482    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zpwj7/must-gather-v7jhx"]
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121767    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121778    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121790    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121796    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121805    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121810    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121817    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="feast-init"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121822    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="feast-init"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121827    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121833    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121839    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="feast-apply"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121843    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="feast-apply"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121850    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="feast-init"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121856    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="feast-init"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121867    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="registry"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121872    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="registry"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121878    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121883    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121888    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="feast-apply"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121893    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="feast-apply"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121899    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121904    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121948    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="ui"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121956    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121964    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121969    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="registry"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121974    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="offline"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121979    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f4b257-146d-4bb4-b7ff-7c88a6e1f933" containerName="online"
Jul 20 16:06:19.121995 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.121985    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc3bacb6-5ee5-43d4-bf6e-23596777dbea" containerName="ui"
Jul 20 16:06:19.126773 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.126737    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.128734 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.128712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpwj7\"/\"openshift-service-ca.crt\""
Jul 20 16:06:19.129185 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.129160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zpwj7\"/\"default-dockercfg-qj9k2\""
Jul 20 16:06:19.129185 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.129182    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zpwj7\"/\"kube-root-ca.crt\""
Jul 20 16:06:19.134237 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.134211    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpwj7/must-gather-v7jhx"]
Jul 20 16:06:19.228276 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.228246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmp8\" (UniqueName: \"kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.228276 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.228280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.328846 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.328819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmp8\" (UniqueName: \"kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.328846 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.328851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.329162 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.329146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.336973 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.336955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmp8\" (UniqueName: \"kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8\") pod \"must-gather-v7jhx\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") " pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.443843 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.443812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:19.573260 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.573236    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zpwj7/must-gather-v7jhx"]
Jul 20 16:06:19.575549 ip-10-0-140-218 kubenswrapper[2558]: W0720 16:06:19.575523    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17039c0b_720e_4432_8d7f_20612b02064e.slice/crio-00a58f704c001d841b3cf316e82e6360ac5145fe26ef61f3cf2c3ad5d7e624a6 WatchSource:0}: Error finding container 00a58f704c001d841b3cf316e82e6360ac5145fe26ef61f3cf2c3ad5d7e624a6: Status 404 returned error can't find the container with id 00a58f704c001d841b3cf316e82e6360ac5145fe26ef61f3cf2c3ad5d7e624a6
Jul 20 16:06:19.577314 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:19.577298    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:06:20.083700 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:20.083670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" event={"ID":"17039c0b-720e-4432-8d7f-20612b02064e","Type":"ContainerStarted","Data":"00a58f704c001d841b3cf316e82e6360ac5145fe26ef61f3cf2c3ad5d7e624a6"}
Jul 20 16:06:27.116948 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:27.116892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" event={"ID":"17039c0b-720e-4432-8d7f-20612b02064e","Type":"ContainerStarted","Data":"2cc15eff7a8ae369b44bc131d8dafbb270f6dae871b22ee99d48ac1bd76a0bd7"}
Jul 20 16:06:27.116948 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:27.116953    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" event={"ID":"17039c0b-720e-4432-8d7f-20612b02064e","Type":"ContainerStarted","Data":"adba00254f2a0ce88913c37f352b61e33a4358d7a31b3c3ef220103ec74458e4"}
Jul 20 16:06:27.133791 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:27.133723    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" podStartSLOduration=1.593526832 podStartE2EDuration="8.13370808s" totalImagesPullingTime="6.540181248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:06:27.131303553 +0000 UTC m=+1955.673031238" watchObservedRunningTime="2026-07-20 16:06:27.13370808 +0000 UTC m=+1955.675435764"
Jul 20 16:06:36.157155 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:36.157124    2558 generic.go:356] "Generic (PLEG): container finished" podID="17039c0b-720e-4432-8d7f-20612b02064e" containerID="adba00254f2a0ce88913c37f352b61e33a4358d7a31b3c3ef220103ec74458e4" exitCode=0
Jul 20 16:06:36.157574 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:36.157172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" event={"ID":"17039c0b-720e-4432-8d7f-20612b02064e","Type":"ContainerDied","Data":"adba00254f2a0ce88913c37f352b61e33a4358d7a31b3c3ef220103ec74458e4"}
Jul 20 16:06:36.157574 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:36.157438    2558 scope.go:117] "RemoveContainer" containerID="adba00254f2a0ce88913c37f352b61e33a4358d7a31b3c3ef220103ec74458e4"
Jul 20 16:06:36.676080 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:36.676051    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zpwj7_must-gather-v7jhx_17039c0b-720e-4432-8d7f-20612b02064e/gather/0.log"
Jul 20 16:06:39.689514 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:39.689487    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jsbw8_ec2f9fae-500a-4e8e-ab2e-f32d040a2565/global-pull-secret-syncer/0.log"
Jul 20 16:06:39.802719 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:39.802689    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjv85_4bb0be9b-b928-4483-b983-d661671e064a/konnectivity-agent/0.log"
Jul 20 16:06:39.897051 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:39.897024    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-218.ec2.internal_b956d4ba6697a743c7af9ebd9f7e685e/haproxy/0.log"
Jul 20 16:06:41.999204 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:41.999165    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-zpwj7/must-gather-v7jhx"]
Jul 20 16:06:41.999719 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:41.999355    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-zpwj7/must-gather-v7jhx" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="copy" containerID="cri-o://2cc15eff7a8ae369b44bc131d8dafbb270f6dae871b22ee99d48ac1bd76a0bd7" gracePeriod=2
Jul 20 16:06:42.006578 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.006549    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-zpwj7/must-gather-v7jhx"]
Jul 20 16:06:42.007552 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:06:42.007515    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17039c0b-720e-4432-8d7f-20612b02064e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-zpwj7\"/\"must-gather-v7jhx\": pods \"must-gather-v7jhx\" not found" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:42.180614 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.180593    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zpwj7_must-gather-v7jhx_17039c0b-720e-4432-8d7f-20612b02064e/copy/0.log"
Jul 20 16:06:42.181039 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.181011    2558 generic.go:356] "Generic (PLEG): container finished" podID="17039c0b-720e-4432-8d7f-20612b02064e" containerID="2cc15eff7a8ae369b44bc131d8dafbb270f6dae871b22ee99d48ac1bd76a0bd7" exitCode=143
Jul 20 16:06:42.224023 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.223997    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zpwj7_must-gather-v7jhx_17039c0b-720e-4432-8d7f-20612b02064e/copy/0.log"
Jul 20 16:06:42.225500 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.225485    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:42.227213 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:06:42.227191    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v7jhx\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zpwj7\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" podUID="17039c0b-720e-4432-8d7f-20612b02064e" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:42.307953 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.307887    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output\") pod \"17039c0b-720e-4432-8d7f-20612b02064e\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") "
Jul 20 16:06:42.307953 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.307928    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkmp8\" (UniqueName: \"kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8\") pod \"17039c0b-720e-4432-8d7f-20612b02064e\" (UID: \"17039c0b-720e-4432-8d7f-20612b02064e\") "
Jul 20 16:06:42.308290 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.308265    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "17039c0b-720e-4432-8d7f-20612b02064e" (UID: "17039c0b-720e-4432-8d7f-20612b02064e"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:06:42.310023 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.310002    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8" (OuterVolumeSpecName: "kube-api-access-nkmp8") pod "17039c0b-720e-4432-8d7f-20612b02064e" (UID: "17039c0b-720e-4432-8d7f-20612b02064e"). InnerVolumeSpecName "kube-api-access-nkmp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:06:42.408862 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.408832    2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17039c0b-720e-4432-8d7f-20612b02064e-must-gather-output\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:42.408862 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.408858    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkmp8\" (UniqueName: \"kubernetes.io/projected/17039c0b-720e-4432-8d7f-20612b02064e-kube-api-access-nkmp8\") on node \"ip-10-0-140-218.ec2.internal\" DevicePath \"\""
Jul 20 16:06:42.497731 ip-10-0-140-218 kubenswrapper[2558]: E0720 16:06:42.497693    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v7jhx\" is forbidden: User \"system:node:ip-10-0-140-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zpwj7\": no relationship found between node 'ip-10-0-140-218.ec2.internal' and this object" podUID="17039c0b-720e-4432-8d7f-20612b02064e" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:42.499200 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:42.499177    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17039c0b-720e-4432-8d7f-20612b02064e" path="/var/lib/kubelet/pods/17039c0b-720e-4432-8d7f-20612b02064e/volumes"
Jul 20 16:06:43.185621 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.185592    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zpwj7_must-gather-v7jhx_17039c0b-720e-4432-8d7f-20612b02064e/copy/0.log"
Jul 20 16:06:43.186052 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.185998    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zpwj7/must-gather-v7jhx"
Jul 20 16:06:43.186052 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.186040    2558 scope.go:117] "RemoveContainer" containerID="2cc15eff7a8ae369b44bc131d8dafbb270f6dae871b22ee99d48ac1bd76a0bd7"
Jul 20 16:06:43.193381 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.193352    2558 scope.go:117] "RemoveContainer" containerID="adba00254f2a0ce88913c37f352b61e33a4358d7a31b3c3ef220103ec74458e4"
Jul 20 16:06:43.485117 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.485032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-rs96q_42621ed7-6705-4db2-ab8f-35efc1aeb727/monitoring-plugin/0.log"
Jul 20 16:06:43.607554 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.607523    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckc2b_e4346d78-702e-4ccf-b928-995773609c6f/node-exporter/0.log"
Jul 20 16:06:43.631503 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.631480    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckc2b_e4346d78-702e-4ccf-b928-995773609c6f/kube-rbac-proxy/0.log"
Jul 20 16:06:43.661467 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.661447    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckc2b_e4346d78-702e-4ccf-b928-995773609c6f/init-textfile/0.log"
Jul 20 16:06:43.766827 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.766735    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jrnr5_7517365c-1b8b-4559-8742-1049876fb64d/kube-rbac-proxy-main/0.log"
Jul 20 16:06:43.793402 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.793376    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jrnr5_7517365c-1b8b-4559-8742-1049876fb64d/kube-rbac-proxy-self/0.log"
Jul 20 16:06:43.826290 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:43.826231    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-jrnr5_7517365c-1b8b-4559-8742-1049876fb64d/openshift-state-metrics/0.log"
Jul 20 16:06:44.198821 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.198790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/thanos-query/0.log"
Jul 20 16:06:44.227608 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.227586    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/kube-rbac-proxy-web/0.log"
Jul 20 16:06:44.271331 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.271307    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/kube-rbac-proxy/0.log"
Jul 20 16:06:44.305503 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.305477    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/prom-label-proxy/0.log"
Jul 20 16:06:44.342533 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.342510    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/kube-rbac-proxy-rules/0.log"
Jul 20 16:06:44.379923 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:44.379893    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57c45b7df6-hq6zg_2852294b-28f2-4cd4-a1e3-6c3c6ec3068f/kube-rbac-proxy-metrics/0.log"
Jul 20 16:06:45.685969 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:45.685938    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-w7t8g_e6865653-823f-49bb-a89d-ad1df0cdf98b/networking-console-plugin/0.log"
Jul 20 16:06:47.779261 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779226    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"]
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779498    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="gather"
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779509    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="gather"
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779518    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="copy"
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779523    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="copy"
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779593    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="gather"
Jul 20 16:06:47.779646 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.779600    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17039c0b-720e-4432-8d7f-20612b02064e" containerName="copy"
Jul 20 16:06:47.782611 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.782592    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.787345 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.787325    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j7msv\"/\"openshift-service-ca.crt\""
Jul 20 16:06:47.787933 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.787915    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j7msv\"/\"kube-root-ca.crt\""
Jul 20 16:06:47.788044 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.787988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j7msv\"/\"default-dockercfg-lr95h\""
Jul 20 16:06:47.793590 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.793570    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"]
Jul 20 16:06:47.850553 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.850509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzz6\" (UniqueName: \"kubernetes.io/projected/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-kube-api-access-9kzz6\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.850723 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.850573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-podres\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.850723 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.850612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-lib-modules\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.850723 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.850641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-proc\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.850723 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.850664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-sys\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.912345 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.912314    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dhxp_bccab366-ff18-488f-982e-1ba9be77e312/dns/0.log"
Jul 20 16:06:47.932988 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.932961    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9dhxp_bccab366-ff18-488f-982e-1ba9be77e312/kube-rbac-proxy/0.log"
Jul 20 16:06:47.951163 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-podres\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951261 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-lib-modules\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951261 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-proc\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951261 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-sys\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951261 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-proc\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951387 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-sys\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951387 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-podres\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951387 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzz6\" (UniqueName: \"kubernetes.io/projected/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-kube-api-access-9kzz6\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.951387 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.951313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-lib-modules\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:47.959449 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:47.959430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzz6\" (UniqueName: \"kubernetes.io/projected/274cd74a-9690-41fd-ac8b-15eb4e5db3c0-kube-api-access-9kzz6\") pod \"perf-node-gather-daemonset-qslzg\" (UID: \"274cd74a-9690-41fd-ac8b-15eb4e5db3c0\") " pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:48.090699 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:48.090606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxxsq_b1953acb-7e74-4ebd-a62c-fd91964d2f5c/dns-node-resolver/0.log"
Jul 20 16:06:48.091647 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:48.091629    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:48.211378 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:48.211246    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"]
Jul 20 16:06:48.213929 ip-10-0-140-218 kubenswrapper[2558]: W0720 16:06:48.213900    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod274cd74a_9690_41fd_ac8b_15eb4e5db3c0.slice/crio-5837e4b687168eeb5ada5a620b641c794304b6a5c48abd5aeb82e66b60bfce9e WatchSource:0}: Error finding container 5837e4b687168eeb5ada5a620b641c794304b6a5c48abd5aeb82e66b60bfce9e: Status 404 returned error can't find the container with id 5837e4b687168eeb5ada5a620b641c794304b6a5c48abd5aeb82e66b60bfce9e
Jul 20 16:06:48.538005 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:48.537975    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2n4ls_23f3f052-b32c-4827-8db6-50391261ae83/node-ca/0.log"
Jul 20 16:06:49.211599 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:49.211568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg" event={"ID":"274cd74a-9690-41fd-ac8b-15eb4e5db3c0","Type":"ContainerStarted","Data":"cce1e18fa2df744a3d6e544a49b04c59cc5b75b82766e4e14548efa6f3732b99"}
Jul 20 16:06:49.212114 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:49.211623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg" event={"ID":"274cd74a-9690-41fd-ac8b-15eb4e5db3c0","Type":"ContainerStarted","Data":"5837e4b687168eeb5ada5a620b641c794304b6a5c48abd5aeb82e66b60bfce9e"}
Jul 20 16:06:49.212114 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:49.211704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:49.239931 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:49.239880    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg" podStartSLOduration=2.2398636610000002 podStartE2EDuration="2.239863661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:06:49.238334568 +0000 UTC m=+1977.780062272" watchObservedRunningTime="2026-07-20 16:06:49.239863661 +0000 UTC m=+1977.781591344"
Jul 20 16:06:49.610725 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:49.610644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzx4m_8be52aba-60eb-46d6-935a-cc9be9ff19f9/serve-healthcheck-canary/0.log"
Jul 20 16:06:50.041169 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:50.041141    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9s6q_786b9372-fee5-4d4a-a407-79907a7131e9/kube-rbac-proxy/0.log"
Jul 20 16:06:50.058999 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:50.058972    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9s6q_786b9372-fee5-4d4a-a407-79907a7131e9/exporter/0.log"
Jul 20 16:06:50.080257 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:50.080233    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w9s6q_786b9372-fee5-4d4a-a407-79907a7131e9/extractor/0.log"
Jul 20 16:06:53.969281 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:53.969252    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sb5rq_5cebc1f5-dec4-41d8-a937-5d310fd2c351/migrator/0.log"
Jul 20 16:06:53.988573 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:53.988543    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-sb5rq_5cebc1f5-dec4-41d8-a937-5d310fd2c351/graceful-termination/0.log"
Jul 20 16:06:54.253941 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:54.253861    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gvt97_3479d0c3-482d-4d34-a112-af3628a4e741/kube-storage-version-migrator-operator/1.log"
Jul 20 16:06:54.254618 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:54.254603    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gvt97_3479d0c3-482d-4d34-a112-af3628a4e741/kube-storage-version-migrator-operator/0.log"
Jul 20 16:06:55.050979 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.050949    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/kube-multus-additional-cni-plugins/0.log"
Jul 20 16:06:55.070439 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.070412    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/egress-router-binary-copy/0.log"
Jul 20 16:06:55.093079 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.093056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/cni-plugins/0.log"
Jul 20 16:06:55.114859 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.114836    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/bond-cni-plugin/0.log"
Jul 20 16:06:55.134630 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.134604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/routeoverride-cni/0.log"
Jul 20 16:06:55.153813 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.153790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/whereabouts-cni-bincopy/0.log"
Jul 20 16:06:55.172801 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.172779    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fsvqs_c39d6958-3486-4a1c-9beb-9dabd5506459/whereabouts-cni/0.log"
Jul 20 16:06:55.224555 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.224531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j7msv/perf-node-gather-daemonset-qslzg"
Jul 20 16:06:55.501095 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.501065    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hrw8g_db58ebef-e2c5-454a-87d3-07b676ec7dd0/kube-multus/0.log"
Jul 20 16:06:55.599511 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.599481    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfwdl_386c94ce-047f-419e-bc49-db7d3da7f6a6/network-metrics-daemon/0.log"
Jul 20 16:06:55.618741 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:55.618716    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hfwdl_386c94ce-047f-419e-bc49-db7d3da7f6a6/kube-rbac-proxy/0.log"
Jul 20 16:06:56.782339 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.782270    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/ovn-controller/0.log"
Jul 20 16:06:56.805499 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.805481    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/ovn-acl-logging/0.log"
Jul 20 16:06:56.830636 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.830611    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/kube-rbac-proxy-node/0.log"
Jul 20 16:06:56.855054 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.855033    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 16:06:56.873025 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.873000    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/northd/0.log"
Jul 20 16:06:56.900133 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.900111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/nbdb/0.log"
Jul 20 16:06:56.924215 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.924199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/sbdb/0.log"
Jul 20 16:06:56.965950 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:56.965930    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4wl4_4928fab0-8438-4b8e-bed5-5042e04456a4/ovnkube-controller/0.log"
Jul 20 16:06:57.886800 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:57.886773    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-mvgbz_0db8b25b-a0de-46ad-a42a-1fb88b907065/check-endpoints/0.log"
Jul 20 16:06:57.909508 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:57.909480    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c7bjv_249627f3-9568-4b3c-82e0-329fb36344ad/network-check-target-container/0.log"
Jul 20 16:06:58.911405 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:58.911375    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xddfj_791e7937-0546-4cab-b488-28293a59042c/iptables-alerter/0.log"
Jul 20 16:06:59.476430 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:06:59.476404    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-49fj5_65796c67-79ca-47fb-b6cd-3dff4919b6dc/tuned/0.log"
Jul 20 16:07:02.114824 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.114798    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-dsnnk_c59f9398-dda2-4c84-b87f-6fa776cf9673/service-ca-operator/1.log"
Jul 20 16:07:02.115409 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.115391    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-dsnnk_c59f9398-dda2-4c84-b87f-6fa776cf9673/service-ca-operator/0.log"
Jul 20 16:07:02.396349 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.396323    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-58598695f7-qlpkp_4433b970-63e3-41f0-98f8-16a8d13f943a/service-ca-controller/0.log"
Jul 20 16:07:02.856170 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.856143    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rzfqm_6aed60fd-677b-4e32-b932-34c26dd31ce5/csi-driver/0.log"
Jul 20 16:07:02.875437 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.875411    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rzfqm_6aed60fd-677b-4e32-b932-34c26dd31ce5/csi-node-driver-registrar/0.log"
Jul 20 16:07:02.894522 ip-10-0-140-218 kubenswrapper[2558]: I0720 16:07:02.894499    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-rzfqm_6aed60fd-677b-4e32-b932-34c26dd31ce5/csi-liveness-probe/0.log"