Sep 08 06:34:45.577056 ip-10-0-132-183 systemd[1]: Starting Kubernetes Kubelet... Sep 08 06:34:46.031008 ip-10-0-132-183 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:46.031008 ip-10-0-132-183 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 06:34:46.031008 ip-10-0-132-183 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:46.031008 ip-10-0-132-183 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 06:34:46.031008 ip-10-0-132-183 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:46.032028 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.031943 2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 06:34:46.036059 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036043 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.036059 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036059 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036063 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036068 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036072 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036075 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036078 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036081 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036085 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036089 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036093 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036097 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036100 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036103 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036106 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036108 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036113 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036115 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036118 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.036123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036131 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036134 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036137 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036140 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036143 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036146 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036148 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036151 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036154 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036156 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036159 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036161 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036164 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036166 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036169 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036171 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036174 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036176 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036179 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036182 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.036554 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036184 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036186 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036189 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036191 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036194 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036196 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036198 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036201 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036203 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036206 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036208 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036211 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036213 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036221 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036224 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036227 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036230 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036232 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036235 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036238 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.037096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036240 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036243 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036245 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036248 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036250 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036253 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036255 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036258 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036261 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036263 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036265 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036269 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036272 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036274 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036277 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036279 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036281 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036284 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036286 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036289 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.037575 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036291 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036294 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036296 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036299 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036301 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036304 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036313 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036318 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036321 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036323 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036326 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036329 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036331 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036333 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036336 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036338 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036341 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036343 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036346 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.038084 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.036348 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037132 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037138 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037142 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037144 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037147 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037152 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037156 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037159 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037162 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037165 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037168 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037170 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037173 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037175 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037178 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037180 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037183 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037185 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037189 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.038618 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037198 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037201 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037204 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037206 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037209 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037211 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037214 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037217 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037219 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037222 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037225 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037227 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037230 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037232 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037235 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037237 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037240 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037242 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037245 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037248 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.039123 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037250 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037253 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037255 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037258 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037261 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037263 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037266 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037268 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037272 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037274 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037277 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037280 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037283 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037291 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037294 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037296 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037299 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037301 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037304 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037307 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.039620 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037309 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037312 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037314 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037316 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037319 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037323 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037326 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037328 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037331 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037333 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037336 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037338 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037341 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037344 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037346 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037349 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037352 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037355 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037357 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037359 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.040155 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037362 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037365 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037367 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037369 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037372 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037374 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037382 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037385 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037388 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037390 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037393 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037395 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037398 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037400 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037402 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037405 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037409 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037413 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037417 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037420 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.040645 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037895 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037902 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037905 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037908 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037911 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037914 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037916 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037919 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037922 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037925 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037928 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037930 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037933 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037936 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037938 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037941 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037943 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037946 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037954 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037957 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.041152 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037959 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037962 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037964 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037967 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037969 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037973 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037977 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037983 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037986 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037989 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037992 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037995 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.037997 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038000 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038002 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038005 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038008 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038010 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038013 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038017 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.041646 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038019 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038022 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038024 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038027 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038030 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038032 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038035 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038038 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038041 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038044 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038046 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038054 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038057 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038060 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038062 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038064 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038067 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038069 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038072 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038076 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.042142 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038078 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038081 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038083 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038086 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038088 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038092 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038095 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038097 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038100 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038102 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038105 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038108 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038111 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038113 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038116 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038118 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038121 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038123 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038126 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.042624 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038130 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038132 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038135 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038138 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038141 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038150 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038152 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038155 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038157 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038160 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038162 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038165 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038168 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038171 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038173 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038176 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038178 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038181 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038183 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.038186 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.043097 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038272 2547 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038311 2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038320 2547 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038325 2547 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038330 2547 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038333 2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038337 2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038344 2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038347 2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038350 2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038353 2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038356 2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038360 2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038363 2547 flags.go:64] FLAG: --cgroup-root="" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038366 2547 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038369 2547 flags.go:64] FLAG: --client-ca-file="" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038371 2547 flags.go:64] FLAG: --cloud-provider="external" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038374 2547 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038387 2547 flags.go:64] FLAG: --cluster-domain="" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038390 2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038393 2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038396 2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038400 2547 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038404 2547 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 06:34:46.043578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038408 2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038411 2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038415 2547 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038418 2547 flags.go:64] FLAG: --contention-profiling="false" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038421 2547 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038424 2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038430 2547 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038433 2547 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038437 2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038440 2547 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038443 2547 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038446 2547 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038450 2547 flags.go:64] FLAG: --enable-server="true" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038453 2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038459 2547 flags.go:64] FLAG: --event-burst="100" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038463 2547 flags.go:64] FLAG: --event-qps="50" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038466 2547 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038469 2547 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038472 2547 flags.go:64] FLAG: --eviction-hard="" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038475 2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038478 2547 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038495 2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038499 2547 flags.go:64] FLAG: --eviction-soft="" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038503 2547 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038506 2547 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 06:34:46.044190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038509 2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038512 2547 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038528 2547 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038531 2547 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038534 2547 flags.go:64] FLAG: --feature-gates="" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038538 2547 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038541 2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038545 2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038548 2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038551 2547 flags.go:64] FLAG: --healthz-port="10248" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038554 2547 flags.go:64] FLAG: --help="false" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038557 2547 flags.go:64] FLAG: --hostname-override="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038560 2547 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038563 2547 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038566 2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038569 2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038573 2547 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038575 2547 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038578 2547 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038582 2547 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038585 2547 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038588 2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038591 2547 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038594 2547 flags.go:64] FLAG: --kube-reserved="" Sep 08 06:34:46.044852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038597 2547 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038599 2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038602 2547 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038605 2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038608 2547 flags.go:64] FLAG: --lock-file="" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038611 2547 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038613 2547 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038616 2547 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038622 2547 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038624 2547 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038627 2547 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038636 2547 flags.go:64] FLAG: --logging-format="text" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038639 2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038642 2547 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038645 2547 flags.go:64] FLAG: --manifest-url="" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038649 2547 flags.go:64] FLAG: --manifest-url-header="" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038653 2547 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038656 2547 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038660 2547 flags.go:64] FLAG: --max-pods="110" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038663 2547 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038666 2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038668 2547 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038671 2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038674 2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038677 2547 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 06:34:46.045443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038680 2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038687 2547 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038691 2547 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038694 2547 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038697 2547 flags.go:64] FLAG: --pod-cidr="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038699 2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038705 2547 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038708 2547 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038711 2547 flags.go:64] FLAG: --pods-per-core="0" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038714 2547 flags.go:64] FLAG: --port="10250" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038722 2547 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038725 2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ba9c75cdf65f3b39" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038728 2547 flags.go:64] FLAG: --qos-reserved="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038731 2547 flags.go:64] FLAG: --read-only-port="10255" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038734 2547 flags.go:64] FLAG: --register-node="true" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038737 2547 flags.go:64] FLAG: --register-with-taints="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038740 2547 flags.go:64] FLAG: --registry-burst="10" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038743 2547 flags.go:64] FLAG: --registry-qps="5" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038746 2547 flags.go:64] FLAG: --reserved-cpus="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038754 2547 flags.go:64] FLAG: --reserved-memory="" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038758 2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038761 2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038765 2547 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038768 2547 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038784 2547 flags.go:64] FLAG: --runonce="false" Sep 08 06:34:46.046213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038788 2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038791 2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038793 2547 flags.go:64] FLAG: --seccomp-default="false" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038796 2547 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038799 2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038802 2547 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038805 2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038808 2547 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038811 2547 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038814 2547 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038817 2547 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038820 2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038823 2547 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038826 2547 flags.go:64] FLAG: --system-cgroups="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038829 2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038835 2547 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038838 2547 flags.go:64] FLAG: --tls-cert-file="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038841 2547 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038848 2547 flags.go:64] FLAG: --tls-min-version="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038850 2547 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038859 2547 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038862 2547 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038865 2547 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038868 2547 flags.go:64] FLAG: --v="2" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038871 2547 flags.go:64] FLAG: --version="false" Sep 08 06:34:46.047167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038876 2547 flags.go:64] FLAG: --vmodule="" Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038879 2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.038888 2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039036 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039041 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039044 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039047 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039049 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039052 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039055 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039057 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039060 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039063 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039066 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039068 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039071 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039073 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039076 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039078 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039081 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.047971 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039084 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039086 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039089 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039091 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039093 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039096 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039098 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039101 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039103 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039106 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039108 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039111 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039113 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039115 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039118 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039128 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039132 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039135 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039137 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039140 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.048484 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039142 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039145 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039147 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039150 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039152 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039155 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039157 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039160 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039162 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039166 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039170 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039173 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039176 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039178 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039181 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039184 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039187 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039189 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039192 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.049013 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039195 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039197 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039200 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039202 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039205 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039207 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039211 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039215 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039218 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039231 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039235 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039238 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039240 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039243 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039247 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039250 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039253 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039256 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039259 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.049481 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039261 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039264 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039266 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039271 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039273 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039276 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039278 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039281 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039283 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039286 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039289 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039291 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039294 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039296 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039299 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039302 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039304 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039307 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039309 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039312 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.050005 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039314 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039317 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039321 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.039328 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.039337 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.048811 2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.048826 2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.048846 2547 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.048853 2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048913 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048917 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048921 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048924 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048926 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048929 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.050489 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048932 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048935 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048937 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048940 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048942 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048945 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048948 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048951 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048953 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048956 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048959 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048961 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048964 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048967 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048969 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048972 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048975 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048978 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048980 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048983 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.050876 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048985 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048988 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048992 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048995 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.048998 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049001 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049004 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049006 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049009 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049012 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049014 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049017 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049020 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049023 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049025 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049028 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049031 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049033 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049036 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.051365 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049039 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049043 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049047 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049050 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049053 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049056 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049059 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049062 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049065 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049068 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049071 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049074 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049076 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049079 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049082 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049085 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049088 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049091 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049094 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.051849 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049096 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049099 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049102 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049105 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049107 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049110 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049112 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049115 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049117 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049120 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049122 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049125 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049129 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049132 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049135 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049139 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049141 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049145 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049148 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049151 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.052315 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049153 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049156 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049158 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049161 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049163 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049166 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049168 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049171 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049175 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049179 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049182 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049185 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049188 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049190 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049193 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.052924 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.049198 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049327 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049333 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049335 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049338 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049341 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049344 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049347 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049349 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049352 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049355 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049357 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049360 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049363 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049366 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049368 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049371 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049373 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049376 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049379 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:46.053370 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049381 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049383 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049387 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049391 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049394 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049397 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049401 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049403 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049406 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049409 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049411 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049414 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049416 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049419 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049421 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049424 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049427 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049429 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049432 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:46.053940 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049434 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049437 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049439 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049442 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049444 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049447 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049449 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049452 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049455 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049457 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049461 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049464 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049468 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049471 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049473 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049476 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049479 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049481 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049484 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:46.054407 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049487 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049490 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049493 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049495 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049498 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049500 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049503 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049506 2547 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049508 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049511 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049513 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049515 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049518 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049521 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049524 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049528 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049530 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049533 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049536 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:46.054989 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049539 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049542 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049545 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049547 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049550 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049553 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049555 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049558 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049560 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049563 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049566 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049568 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049570 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049573 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049576 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049578 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049581 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049583 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049586 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049589 2547 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:46.055452 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049591 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049594 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:46.049596 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.049601 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.049698 2547 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.053247 2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.054365 2547 server.go:1019] "Starting client certificate rotation" Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.054490 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 06:34:46.056182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.054538 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 06:34:46.057217 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.057203 2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 06:34:46.058404 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.058383 2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 06:34:46.067600 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.067580 2547 log.go:25] "Validated CRI v1 runtime API" Sep 08 06:34:46.072829 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.072812 2547 log.go:25] "Validated CRI v1 image API" Sep 08 06:34:46.073654 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.073640 2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 06:34:46.077185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.077130 2547 fs.go:135] Filesystem UUIDs: map[60a1921c-9b64-4310-82b4-c719100da386:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ff028767-6c02-438a-90a4-f346301d12e2:/dev/nvme0n1p3] Sep 08 06:34:46.077185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.077153 2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 06:34:46.082052 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.082033 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 06:34:46.084052 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.083934 2547 manager.go:216] Machine: {Timestamp:2026-09-08 06:34:46.082499576 +0000 UTC m=+0.380543788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099666 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb657e9bc6ceff77041b7ea284e02 SystemUUID:ec2bb657-e9bc-6cef-f770-41b7ea284e02 BootID:ed1e07b5-7a25-4463-a4e6-80d867fee83c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9a:8e:26:fe:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9a:8e:26:fe:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:9e:3e:49:6f:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 06:34:46.084052 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.084044 2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 06:34:46.084164 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.084129 2547 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 06:34:46.087810 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.087785 2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 06:34:46.087948 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.087813 2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 06:34:46.088650 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.088641 2547 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 06:34:46.088682 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.088653 2547 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 06:34:46.088682 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.088660 2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 06:34:46.088682 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.088674 2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 06:34:46.090584 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.090574 2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 06:34:46.095225 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095214 2547 state_mem.go:36] "Initialized new in-memory state store" Sep 08 06:34:46.095337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095328 2547 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 06:34:46.095365 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095356 2547 kubelet.go:486] "Attempting to sync node with API server" Sep 08 06:34:46.095365 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095365 2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 06:34:46.095424 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095382 2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 06:34:46.095424 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095392 2547 kubelet.go:398] "Adding apiserver pod source" Sep 08 06:34:46.095424 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095408 2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 06:34:46.095749 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095735 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 06:34:46.095805 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.095757 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 06:34:46.098210 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.098190 2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 06:34:46.101237 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101221 2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 06:34:46.101291 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101252 2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 06:34:46.101408 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101399 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 06:34:46.101450 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101415 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 06:34:46.101450 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101421 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 06:34:46.101450 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101427 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 06:34:46.101450 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101435 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 06:34:46.101450 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.101448 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 06:34:46.102032 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102023 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 06:34:46.102032 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102032 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 06:34:46.102095 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102039 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 06:34:46.102095 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102045 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 06:34:46.102095 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102055 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 06:34:46.102095 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102063 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 06:34:46.102917 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102905 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 06:34:46.102917 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.102915 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 06:34:46.105596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.105574 2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 06:34:46.106374 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.106354 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 06:34:46.106432 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.106356 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 06:34:46.106722 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.106710 2547 server.go:1268] "Started kubelet" Sep 08 06:34:46.107270 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.107237 2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 06:34:46.107757 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.107485 2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 06:34:46.107757 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.107563 2547 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 06:34:46.107685 ip-10-0-132-183 systemd[1]: Started Kubernetes Kubelet. Sep 08 06:34:46.108255 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.108233 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9gxm" Sep 08 06:34:46.109024 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.108999 2547 server.go:310] "Adding debug handlers to kubelet server" Sep 08 06:34:46.109165 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.109141 2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 06:34:46.114216 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.114200 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9gxm" Sep 08 06:34:46.114325 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.114309 2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 06:34:46.114845 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.113669 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-183.ec2.internal.18d344f2af1997c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-183.ec2.internal,UID:ip-10-0-132-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-183.ec2.internal,},FirstTimestamp:2026-09-08 06:34:46.106683332 +0000 UTC m=+0.404727544,LastTimestamp:2026-09-08 06:34:46.106683332 +0000 UTC m=+0.404727544,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-183.ec2.internal,}" Sep 08 06:34:46.115355 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.115339 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 06:34:46.116027 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.116010 2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 06:34:46.116115 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.116095 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.117016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.116910 2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 06:34:46.118202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.116989 2547 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 06:34:46.118341 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118330 2547 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 06:34:46.118512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.117431 2547 factory.go:153] Registering CRI-O factory Sep 08 06:34:46.118615 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118604 2547 factory.go:223] Registration of the crio container factory successfully Sep 08 06:34:46.118753 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118733 2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 06:34:46.118872 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118860 2547 factory.go:55] Registering systemd factory Sep 08 06:34:46.119099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118973 2547 factory.go:223] Registration of the systemd container factory successfully Sep 08 06:34:46.119099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118921 2547 reconstruct.go:97] "Volume reconstruction finished" Sep 08 06:34:46.119099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.118996 2547 factory.go:103] Registering Raw factory Sep 08 06:34:46.119099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.119000 2547 reconciler.go:29] "Reconciler: start to sync state" Sep 08 06:34:46.119099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.119014 2547 manager.go:1196] Started watching for new ooms in manager Sep 08 06:34:46.120062 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.120042 2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:46.120829 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.120812 2547 manager.go:349] Starting recovery of all containers Sep 08 06:34:46.123689 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.123663 2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-183.ec2.internal\" not found" node="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.131601 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.131583 2547 manager.go:354] Recovery completed Sep 08 06:34:46.136288 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.136273 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.138513 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.138494 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.138616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.138532 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.138616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.138548 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.139213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.139197 2547 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 06:34:46.139213 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.139210 2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 06:34:46.139318 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.139214 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.139318 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.139235 2547 state_mem.go:36] "Initialized new in-memory state store" Sep 08 06:34:46.140074 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.140059 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.140127 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.140086 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.140127 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.140096 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.141274 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.141264 2547 policy_none.go:49] "None policy: Start" Sep 08 06:34:46.141317 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.141278 2547 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 06:34:46.141317 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.141288 2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 06:34:46.143225 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.143214 2547 policy_none.go:47] "Start" Sep 08 06:34:46.176436 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.176418 2547 manager.go:337] "Starting Device Plugin manager" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.176455 2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.176468 2547 server.go:87] "Starting device plugin registration server" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.176839 2547 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.176851 2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.176993 2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.177086 2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.177096 2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.177670 2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.177730 2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.191424 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.192487 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.192526 2547 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.192545 2547 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.192577 2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 06:34:46.199506 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.194457 2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:46.277611 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.277581 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.278628 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.278612 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.278703 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.278642 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.278703 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.278656 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.278703 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.278692 2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.285201 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.285112 2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.285201 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.285138 2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-183.ec2.internal\": node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.292986 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.292967 2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal"] Sep 08 06:34:46.293065 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.293031 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.295300 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.294236 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.295300 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.294274 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.295300 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.294287 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.296669 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.296652 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.296814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.296789 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.296865 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.296820 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.297462 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297444 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.297524 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297475 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.297524 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297484 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.297524 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297448 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.297524 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297522 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.297649 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.297534 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.299170 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.299152 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.299694 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.299678 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.299800 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.299708 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:46.300438 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.300420 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:46.300509 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.300450 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:46.300509 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.300459 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:46.320347 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.320330 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c749b6c2a01b1fce303e8fb7539e8c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-183.ec2.internal\" (UID: \"1c749b6c2a01b1fce303e8fb7539e8c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.320439 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.320354 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.320439 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.320372 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.334458 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.334440 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-183.ec2.internal\" not found" node="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.338050 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.338033 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-183.ec2.internal\" not found" node="ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.399522 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.399498 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.420584 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420561 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c749b6c2a01b1fce303e8fb7539e8c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-183.ec2.internal\" (UID: \"1c749b6c2a01b1fce303e8fb7539e8c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.420670 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420612 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c749b6c2a01b1fce303e8fb7539e8c0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-183.ec2.internal\" (UID: \"1c749b6c2a01b1fce303e8fb7539e8c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.420670 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420646 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.420670 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420664 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.420793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420698 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.420793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.420725 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/310c63446c4dc1a1ade4a56efe09d277-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal\" (UID: \"310c63446c4dc1a1ade4a56efe09d277\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.500532 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.500499 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.601408 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.601351 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.637939 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.637910 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.641716 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:46.641697 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:46.702176 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.702143 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:46.802746 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:46.802720 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.392313 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:48.392244 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.492859 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:48.492823 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.543408 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.543385 2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 06:34:48.543807 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.543540 2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 06:34:48.543807 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.543556 2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 06:34:48.593946 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:48.593914 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.606603 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.606570 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 06:29:47 +0000 UTC" deadline="2028-06-10 11:33:52.6390839 +0000 UTC" Sep 08 06:34:48.606603 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.606595 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15388h59m4.032491341s" Sep 08 06:34:48.695081 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:48.695015 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.795532 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:48.795500 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-183.ec2.internal\" not found" Sep 08 06:34:48.798420 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.798399 2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:48.805127 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.805100 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" Sep 08 06:34:48.816470 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.816453 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 06:34:48.818492 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.818477 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" Sep 08 06:34:48.826539 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.826522 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 06:34:48.870609 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:48.870575 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c749b6c2a01b1fce303e8fb7539e8c0.slice/crio-14fe5491c164849ccc93f8314e0667fc6ae0d8df43babed67f8df1dab26ba2bc WatchSource:0}: Error finding container 14fe5491c164849ccc93f8314e0667fc6ae0d8df43babed67f8df1dab26ba2bc: Status 404 returned error can't find the container with id 14fe5491c164849ccc93f8314e0667fc6ae0d8df43babed67f8df1dab26ba2bc Sep 08 06:34:48.871096 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:48.871076 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310c63446c4dc1a1ade4a56efe09d277.slice/crio-2aa837ea4dca5f5f3a7f824e46a5a39513ce3935e013af70a74ab3f8858c8a6b WatchSource:0}: Error finding container 2aa837ea4dca5f5f3a7f824e46a5a39513ce3935e013af70a74ab3f8858c8a6b: Status 404 returned error can't find the container with id 2aa837ea4dca5f5f3a7f824e46a5a39513ce3935e013af70a74ab3f8858c8a6b Sep 08 06:34:48.875429 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.875405 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:34:48.937977 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:48.937950 2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:49.364917 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.364884 2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:49.585790 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.585749 2547 apiserver.go:52] "Watching apiserver" Sep 08 06:34:49.591982 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.591787 2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 06:34:49.595137 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.595098 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2n9tm","openshift-dns/node-resolver-vct6x","openshift-image-registry/node-ca-jv46b","openshift-multus/network-metrics-daemon-vfqp2","openshift-network-diagnostics/network-check-target-r4pjv","openshift-network-operator/iptables-alerter-5bbqf","openshift-ovn-kubernetes/ovnkube-node-2zbx9","kube-system/global-pull-secret-syncer-fx7b4","kube-system/konnectivity-agent-vj5sv","kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal","openshift-multus/multus-additional-cni-plugins-hx5ks","openshift-multus/multus-mhsr2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np"] Sep 08 06:34:49.598676 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.597824 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.600533 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.600195 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.601445 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.601425 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 06:34:49.601723 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.601687 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 06:34:49.601957 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.601939 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.602169 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.602117 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 06:34:49.602339 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.602295 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.602522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.602505 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-scdh4\"" Sep 08 06:34:49.602803 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.602784 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 06:34:49.603075 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.603057 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.604567 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.604536 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 06:34:49.604686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.604605 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.604770 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.604693 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 06:34:49.604770 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.604694 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.609197 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.610165 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.610466 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.611563 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.611981 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.612057 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7mdf\"" Sep 08 06:34:49.613175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.612397 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.614735 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.614612 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:49.615500 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.614922 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qqmkr\"" Sep 08 06:34:49.615500 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.615152 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:49.620124 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620012 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620629 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-conf-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620650 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9411fc0-ebff-49fc-8121-b0a986212212-serviceca\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620667 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtw4\" (UniqueName: \"kubernetes.io/projected/e9411fc0-ebff-49fc-8121-b0a986212212-kube-api-access-bqtw4\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620689 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-var-lib-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620733 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-ovn\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.620797 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620771 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-node-log\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620805 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-bin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620839 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9411fc0-ebff-49fc-8121-b0a986212212-host\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620871 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620903 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-kubelet\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620924 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-systemd-units\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620947 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-slash\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.620987 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovn-node-metrics-cert\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621011 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-systemd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621034 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-bin\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621056 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-config\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621081 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-cni-binary-copy\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.621139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621103 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-hostroot\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621141 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lghd\" (UniqueName: \"kubernetes.io/projected/328b049c-7a58-48a1-b835-472bf306f6b8-kube-api-access-4lghd\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621172 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621231 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621267 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621293 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-env-overrides\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.621793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.621323 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.622465 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622446 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 06:34:49.622979 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622952 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.623579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622840 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zxrvx\"" Sep 08 06:34:49.623579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622810 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.623579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622944 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.623579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.622844 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 06:34:49.624045 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.623951 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-log-socket\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.624372 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624355 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-system-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624475 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624458 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624543 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624488 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-netns\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624543 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624513 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-multus-certs\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624639 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624539 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-etc-kubernetes\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624639 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624562 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-netns\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.624639 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624584 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-etc-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.624639 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624608 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxznd\" (UniqueName: \"kubernetes.io/projected/cfb4d491-ae35-479a-85df-e41f06cc209b-kube-api-access-wxznd\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.624913 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624860 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-socket-dir-parent\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624984 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624941 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-multus\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.624984 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624971 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-netd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.625087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.624994 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmlm\" (UniqueName: \"kubernetes.io/projected/de37eb23-d595-4a79-8a43-5ebe7b6dd062-kube-api-access-jsmlm\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.625087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625016 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-multus-daemon-config\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.625087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625041 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-script-lib\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.625087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625072 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-cnibin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.625286 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625096 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-k8s-cni-cncf-io\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.625286 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625139 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-kubelet\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.625505 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.625489 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.627581 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.627560 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.628148 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.628129 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 06:34:49.628278 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.628254 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 06:34:49.628660 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.628524 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.628660 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.628563 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.628822 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.628678 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hdvgk\"" Sep 08 06:34:49.629262 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.629244 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9g9nf\"" Sep 08 06:34:49.630480 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.630462 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.630791 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.630758 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.631082 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.631067 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzmcb\"" Sep 08 06:34:49.631290 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.630467 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.632691 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.632674 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.633110 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.632762 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:34:49.633521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.633375 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 06:34:49.634591 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.634575 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 06:34:49.635120 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.635098 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.635686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.635478 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zgnn9\"" Sep 08 06:34:49.635809 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.635793 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 06:34:49.637120 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.637100 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 06:34:49.637951 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.637919 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 06:34:49.638106 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.638084 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwq8m\"" Sep 08 06:34:49.650633 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.650353 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4p9sv" Sep 08 06:34:49.659481 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.659457 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4p9sv" Sep 08 06:34:49.696007 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.695936 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" event={"ID":"310c63446c4dc1a1ade4a56efe09d277","Type":"ContainerStarted","Data":"2aa837ea4dca5f5f3a7f824e46a5a39513ce3935e013af70a74ab3f8858c8a6b"} Sep 08 06:34:49.699886 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.699844 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" event={"ID":"1c749b6c2a01b1fce303e8fb7539e8c0","Type":"ContainerStarted","Data":"14fe5491c164849ccc93f8314e0667fc6ae0d8df43babed67f8df1dab26ba2bc"} Sep 08 06:34:49.708937 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.708908 2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725527 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-config\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725563 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-hostroot\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725580 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lghd\" (UniqueName: \"kubernetes.io/projected/328b049c-7a58-48a1-b835-472bf306f6b8-kube-api-access-4lghd\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725598 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5a0a08-bad3-43d2-a7df-28cca89688b7-host-slash\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725653 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-hostroot\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725643 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725784 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-registration-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725818 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725845 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-log-socket\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725856 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725872 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-system-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725898 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-netns\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725921 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-multus-certs\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725936 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-log-socket\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.725958 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725978 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-netns\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725986 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-multus-certs\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725945 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-etc-kubernetes\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.725988 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-system-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726036 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-etc-kubernetes\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.726047 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:34:50.226006323 +0000 UTC m=+3.035114885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726065 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbgh9\" (UniqueName: \"kubernetes.io/projected/8b5a0a08-bad3-43d2-a7df-28cca89688b7-kube-api-access-cbgh9\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726092 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-run\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726116 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-etc-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726140 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-socket-dir-parent\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726164 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-conf\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726180 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-etc-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726188 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-sys\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726211 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xkcv\" (UniqueName: \"kubernetes.io/projected/e6c7a368-f33a-49c7-a8b0-faa625a90a51-kube-api-access-5xkcv\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726213 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-socket-dir-parent\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726260 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cnibin\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726294 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726323 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.726955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726353 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-netd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726375 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-host\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726398 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b861c3d-3342-4009-ae7c-ec909768e808-hosts-file\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726426 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrvv\" (UniqueName: \"kubernetes.io/projected/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kube-api-access-cdrvv\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726438 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-netd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726451 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-cnibin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726476 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-k8s-cni-cncf-io\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726499 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-kubelet\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726508 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-cnibin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726522 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-conf-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726534 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-run-k8s-cni-cncf-io\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726545 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9411fc0-ebff-49fc-8121-b0a986212212-serviceca\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726558 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-kubelet\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726569 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/774f36e1-bcfc-47fd-a383-86d332d68292-konnectivity-ca\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726602 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726628 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56h6d\" (UniqueName: \"kubernetes.io/projected/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-kube-api-access-56h6d\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726654 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-node-log\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.727739 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726677 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-bin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726725 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-kubelet-config\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726746 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-device-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726769 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovn-node-metrics-cert\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726791 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726814 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-systemd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726864 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-bin\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726887 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-cni-binary-copy\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726912 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-systemd\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726936 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726957 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-sys-fs\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.726980 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727010 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727033 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-env-overrides\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727055 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727081 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.728596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727106 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5a0a08-bad3-43d2-a7df-28cca89688b7-iptables-alerter-script\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727131 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-netns\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727131 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-config\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727178 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-conf-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727218 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxznd\" (UniqueName: \"kubernetes.io/projected/cfb4d491-ae35-479a-85df-e41f06cc209b-kube-api-access-wxznd\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727247 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-node-log\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727293 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-bin\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727381 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727438 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-systemd\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727477 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-cni-bin\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727497 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-multus\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727580 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-multus-cni-dir\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727625 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727828 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9411fc0-ebff-49fc-8121-b0a986212212-serviceca\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727904 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-run-netns\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727247 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/328b049c-7a58-48a1-b835-472bf306f6b8-host-var-lib-cni-multus\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727967 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.729466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.727999 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-etc-selinux\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728018 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-cni-binary-copy\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728030 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmlm\" (UniqueName: \"kubernetes.io/projected/de37eb23-d595-4a79-8a43-5ebe7b6dd062-kube-api-access-jsmlm\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728044 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-env-overrides\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728059 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-multus-daemon-config\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728087 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-tuned\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728109 2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728114 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-socket-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728217 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-kubernetes\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728273 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-script-lib\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728299 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtw4\" (UniqueName: \"kubernetes.io/projected/e9411fc0-ebff-49fc-8121-b0a986212212-kube-api-access-bqtw4\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728322 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/774f36e1-bcfc-47fd-a383-86d332d68292-agent-certs\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728518 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/328b049c-7a58-48a1-b835-472bf306f6b8-multus-daemon-config\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728630 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-lib-modules\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728659 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-var-lib-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728691 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-ovn\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728727 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9411fc0-ebff-49fc-8121-b0a986212212-host\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728747 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-dbus\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.730356 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728766 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-var-lib-kubelet\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728784 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-tmp\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728804 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlwwf\" (UniqueName: \"kubernetes.io/projected/6b861c3d-3342-4009-ae7c-ec909768e808-kube-api-access-jlwwf\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728825 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728836 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovnkube-script-lib\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728847 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728871 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-kubelet\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728891 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-systemd-units\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728910 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-slash\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728922 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-var-lib-openvswitch\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728930 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-modprobe-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728954 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysconfig\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728975 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b861c3d-3342-4009-ae7c-ec909768e808-tmp-dir\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.728976 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-run-ovn\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.729059 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-slash\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.729084 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9411fc0-ebff-49fc-8121-b0a986212212-host\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.729101 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-host-kubelet\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.731250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.729171 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de37eb23-d595-4a79-8a43-5ebe7b6dd062-systemd-units\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.733281 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.733046 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de37eb23-d595-4a79-8a43-5ebe7b6dd062-ovn-node-metrics-cert\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.734197 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.734172 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:49.734295 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.734203 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:49.734295 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.734218 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:49.734295 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.734288 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:34:50.234266543 +0000 UTC m=+3.043375124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:49.739189 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.739112 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lghd\" (UniqueName: \"kubernetes.io/projected/328b049c-7a58-48a1-b835-472bf306f6b8-kube-api-access-4lghd\") pod \"multus-mhsr2\" (UID: \"328b049c-7a58-48a1-b835-472bf306f6b8\") " pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.739189 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.739153 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxznd\" (UniqueName: \"kubernetes.io/projected/cfb4d491-ae35-479a-85df-e41f06cc209b-kube-api-access-wxznd\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:49.740546 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.740519 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtw4\" (UniqueName: \"kubernetes.io/projected/e9411fc0-ebff-49fc-8121-b0a986212212-kube-api-access-bqtw4\") pod \"node-ca-jv46b\" (UID: \"e9411fc0-ebff-49fc-8121-b0a986212212\") " pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.741608 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.741580 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmlm\" (UniqueName: \"kubernetes.io/projected/de37eb23-d595-4a79-8a43-5ebe7b6dd062-kube-api-access-jsmlm\") pod \"ovnkube-node-2zbx9\" (UID: \"de37eb23-d595-4a79-8a43-5ebe7b6dd062\") " pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.787419 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.787382 2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829220 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829271 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5a0a08-bad3-43d2-a7df-28cca89688b7-iptables-alerter-script\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829418 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829450 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-etc-selinux\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829473 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-tuned\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829496 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-socket-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829518 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-kubernetes\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829550 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/774f36e1-bcfc-47fd-a383-86d332d68292-agent-certs\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829560 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-etc-selinux\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829574 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-lib-modules\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829607 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-dbus\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829628 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-socket-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829631 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-var-lib-kubelet\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829659 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-tmp\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829685 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlwwf\" (UniqueName: \"kubernetes.io/projected/6b861c3d-3342-4009-ae7c-ec909768e808-kube-api-access-jlwwf\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829689 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-lib-modules\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.830108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829727 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829762 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-kubernetes\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829517 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-system-cni-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829775 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-modprobe-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829780 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-dbus\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829867 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-modprobe-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829879 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b5a0a08-bad3-43d2-a7df-28cca89688b7-iptables-alerter-script\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829892 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysconfig\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829906 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829918 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b861c3d-3342-4009-ae7c-ec909768e808-tmp-dir\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829662 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-var-lib-kubelet\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829946 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5a0a08-bad3-43d2-a7df-28cca89688b7-host-slash\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.829974 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-registration-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830013 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbgh9\" (UniqueName: \"kubernetes.io/projected/8b5a0a08-bad3-43d2-a7df-28cca89688b7-kube-api-access-cbgh9\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830038 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-run\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830055 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysconfig\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830065 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-conf\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.831109 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830089 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-sys\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830105 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-registration-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830138 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b5a0a08-bad3-43d2-a7df-28cca89688b7-host-slash\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830159 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xkcv\" (UniqueName: \"kubernetes.io/projected/e6c7a368-f33a-49c7-a8b0-faa625a90a51-kube-api-access-5xkcv\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830182 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cnibin\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830202 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830225 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830249 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-host\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830254 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-sys\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830260 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-conf\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830273 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b861c3d-3342-4009-ae7c-ec909768e808-hosts-file\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830303 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrvv\" (UniqueName: \"kubernetes.io/projected/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kube-api-access-cdrvv\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830314 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-run\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830334 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/774f36e1-bcfc-47fd-a383-86d332d68292-konnectivity-ca\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830359 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830446 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830479 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cnibin\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830590 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-host\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830612 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830200 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b861c3d-3342-4009-ae7c-ec909768e808-tmp-dir\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830636 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b861c3d-3342-4009-ae7c-ec909768e808-hosts-file\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830359 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-sysctl-d\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830858 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56h6d\" (UniqueName: \"kubernetes.io/projected/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-kube-api-access-56h6d\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830892 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-kubelet-config\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830919 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-device-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830954 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830973 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-kubelet-config\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830982 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-systemd\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831014 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831039 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-sys-fs\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831125 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-sys-fs\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831196 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/774f36e1-bcfc-47fd-a383-86d332d68292-konnectivity-ca\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831214 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-systemd\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.830922 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.832794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831253 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-device-dir\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.831284 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:49.831334 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:50.331317719 +0000 UTC m=+3.140426282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.831564 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.832314 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-tmp\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.832385 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6c7a368-f33a-49c7-a8b0-faa625a90a51-etc-tuned\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.833616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.833165 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/774f36e1-bcfc-47fd-a383-86d332d68292-agent-certs\") pod \"konnectivity-agent-vj5sv\" (UID: \"774f36e1-bcfc-47fd-a383-86d332d68292\") " pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.838066 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.838037 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlwwf\" (UniqueName: \"kubernetes.io/projected/6b861c3d-3342-4009-ae7c-ec909768e808-kube-api-access-jlwwf\") pod \"node-resolver-vct6x\" (UID: \"6b861c3d-3342-4009-ae7c-ec909768e808\") " pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.838775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.838753 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrvv\" (UniqueName: \"kubernetes.io/projected/ec53fdcf-d5a7-4ace-bafa-ce3837d1da28-kube-api-access-cdrvv\") pod \"aws-ebs-csi-driver-node-hs4np\" (UID: \"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.838955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.838936 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbgh9\" (UniqueName: \"kubernetes.io/projected/8b5a0a08-bad3-43d2-a7df-28cca89688b7-kube-api-access-cbgh9\") pod \"iptables-alerter-5bbqf\" (UID: \"8b5a0a08-bad3-43d2-a7df-28cca89688b7\") " pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.839943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.839920 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56h6d\" (UniqueName: \"kubernetes.io/projected/bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1-kube-api-access-56h6d\") pod \"multus-additional-cni-plugins-hx5ks\" (UID: \"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1\") " pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:49.840143 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.840112 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xkcv\" (UniqueName: \"kubernetes.io/projected/e6c7a368-f33a-49c7-a8b0-faa625a90a51-kube-api-access-5xkcv\") pod \"tuned-2n9tm\" (UID: \"e6c7a368-f33a-49c7-a8b0-faa625a90a51\") " pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.918046 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.917961 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:34:49.928986 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.928918 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhsr2" Sep 08 06:34:49.939644 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.939618 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv46b" Sep 08 06:34:49.948481 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.948457 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bbqf" Sep 08 06:34:49.954906 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.954878 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:34:49.963657 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.963631 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" Sep 08 06:34:49.972212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.972187 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vct6x" Sep 08 06:34:49.983024 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.982997 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" Sep 08 06:34:49.992933 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:49.992904 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" Sep 08 06:34:50.234892 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:50.234813 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:50.234892 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:50.234864 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:50.235103 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235012 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:50.235103 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235034 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:50.235103 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235065 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:50.235103 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235079 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:34:51.235058987 +0000 UTC m=+4.044167565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:50.235103 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235080 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:50.235277 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.235121 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:34:51.235111747 +0000 UTC m=+4.044220318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:50.335646 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:50.335610 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:50.335844 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.335761 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:50.335844 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:50.335819 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:51.335804395 +0000 UTC m=+4.144912959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:50.663461 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:50.663408 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:29:49 +0000 UTC" deadline="2028-04-10 01:37:47.254681632 +0000 UTC" Sep 08 06:34:50.663461 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:50.663456 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13915h2m56.591229162s" Sep 08 06:34:50.965702 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.965676 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5a0a08_bad3_43d2_a7df_28cca89688b7.slice/crio-c0c7ca0716a91e8724339ece4711192ff3d0a9e3ff15018f4b31936900438e0b WatchSource:0}: Error finding container c0c7ca0716a91e8724339ece4711192ff3d0a9e3ff15018f4b31936900438e0b: Status 404 returned error can't find the container with id c0c7ca0716a91e8724339ece4711192ff3d0a9e3ff15018f4b31936900438e0b Sep 08 06:34:50.971062 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.970952 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9411fc0_ebff_49fc_8121_b0a986212212.slice/crio-851ebe4a7bfb3a9f5aa59976a00cff647422df208b38b2f930e539292f81496c WatchSource:0}: Error finding container 851ebe4a7bfb3a9f5aa59976a00cff647422df208b38b2f930e539292f81496c: Status 404 returned error can't find the container with id 851ebe4a7bfb3a9f5aa59976a00cff647422df208b38b2f930e539292f81496c Sep 08 06:34:50.971737 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.971698 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde37eb23_d595_4a79_8a43_5ebe7b6dd062.slice/crio-775ba141801491b95623e0779a1f2bf6d83ea28c3c33997989134fc79019a61e WatchSource:0}: Error finding container 775ba141801491b95623e0779a1f2bf6d83ea28c3c33997989134fc79019a61e: Status 404 returned error can't find the container with id 775ba141801491b95623e0779a1f2bf6d83ea28c3c33997989134fc79019a61e Sep 08 06:34:50.972584 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.972553 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec53fdcf_d5a7_4ace_bafa_ce3837d1da28.slice/crio-dbce00ae2c1f1988561697a83965e5b8ac54351dce5cab28bf6ef511b8258cab WatchSource:0}: Error finding container dbce00ae2c1f1988561697a83965e5b8ac54351dce5cab28bf6ef511b8258cab: Status 404 returned error can't find the container with id dbce00ae2c1f1988561697a83965e5b8ac54351dce5cab28bf6ef511b8258cab Sep 08 06:34:50.974851 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.974830 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c7a368_f33a_49c7_a8b0_faa625a90a51.slice/crio-197026cd51b180ff9a8203001f9c0788fc0b492f009d0609d7f9604a7e42c7b5 WatchSource:0}: Error finding container 197026cd51b180ff9a8203001f9c0788fc0b492f009d0609d7f9604a7e42c7b5: Status 404 returned error can't find the container with id 197026cd51b180ff9a8203001f9c0788fc0b492f009d0609d7f9604a7e42c7b5 Sep 08 06:34:50.975329 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.975262 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfae9c3_bc3a_4d4e_9b3c_b2383ed6d8d1.slice/crio-b3edb178439ec24a30d46a8723171b3c4dd288e973606fae3e5eaf73255a9445 WatchSource:0}: Error finding container b3edb178439ec24a30d46a8723171b3c4dd288e973606fae3e5eaf73255a9445: Status 404 returned error can't find the container with id b3edb178439ec24a30d46a8723171b3c4dd288e973606fae3e5eaf73255a9445 Sep 08 06:34:50.976028 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.976010 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b861c3d_3342_4009_ae7c_ec909768e808.slice/crio-e18743b05561718f531c58fcfe154bdd165fc3c1c8e3bc408cfa127aa4d2ae7b WatchSource:0}: Error finding container e18743b05561718f531c58fcfe154bdd165fc3c1c8e3bc408cfa127aa4d2ae7b: Status 404 returned error can't find the container with id e18743b05561718f531c58fcfe154bdd165fc3c1c8e3bc408cfa127aa4d2ae7b Sep 08 06:34:50.976787 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.976770 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328b049c_7a58_48a1_b835_472bf306f6b8.slice/crio-a89f342342f4b50d7e085a04495b297c6309f0d8f9eeddb932aa5b766337d3e6 WatchSource:0}: Error finding container a89f342342f4b50d7e085a04495b297c6309f0d8f9eeddb932aa5b766337d3e6: Status 404 returned error can't find the container with id a89f342342f4b50d7e085a04495b297c6309f0d8f9eeddb932aa5b766337d3e6 Sep 08 06:34:50.978631 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:34:50.978610 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774f36e1_bcfc_47fd_a383_86d332d68292.slice/crio-b948fc38e946501082646500f4b53fa1b52d0b17280ed8209871a7b49c8bf11b WatchSource:0}: Error finding container b948fc38e946501082646500f4b53fa1b52d0b17280ed8209871a7b49c8bf11b: Status 404 returned error can't find the container with id b948fc38e946501082646500f4b53fa1b52d0b17280ed8209871a7b49c8bf11b Sep 08 06:34:51.241139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.241112 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:51.241250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.241162 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:51.241307 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241279 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:51.241353 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241302 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:51.241353 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241332 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:51.241353 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241347 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:51.241454 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241353 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:34:53.241330269 +0000 UTC m=+6.050438847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:51.241454 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.241401 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:34:53.241382648 +0000 UTC m=+6.050491221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:51.341813 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.341737 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:51.341980 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.341885 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:51.341980 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.341977 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:53.34195558 +0000 UTC m=+6.151064153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:51.663895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.663851 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:29:49 +0000 UTC" deadline="2028-02-25 07:45:01.903759747 +0000 UTC" Sep 08 06:34:51.663895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.663885 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12841h10m10.239878582s" Sep 08 06:34:51.682952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.682816 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:51.682952 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.682936 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:51.683392 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.683334 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:51.683455 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.683426 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:34:51.683825 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.683796 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:51.683929 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:51.683909 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:51.711955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.711851 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerStarted","Data":"b3edb178439ec24a30d46a8723171b3c4dd288e973606fae3e5eaf73255a9445"} Sep 08 06:34:51.719827 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.719657 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" event={"ID":"e6c7a368-f33a-49c7-a8b0-faa625a90a51","Type":"ContainerStarted","Data":"197026cd51b180ff9a8203001f9c0788fc0b492f009d0609d7f9604a7e42c7b5"} Sep 08 06:34:51.722439 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.722407 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"775ba141801491b95623e0779a1f2bf6d83ea28c3c33997989134fc79019a61e"} Sep 08 06:34:51.725321 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.725244 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bbqf" event={"ID":"8b5a0a08-bad3-43d2-a7df-28cca89688b7","Type":"ContainerStarted","Data":"c0c7ca0716a91e8724339ece4711192ff3d0a9e3ff15018f4b31936900438e0b"} Sep 08 06:34:51.737477 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.736893 2547 generic.go:356] "Generic (PLEG): container finished" podID="310c63446c4dc1a1ade4a56efe09d277" containerID="818bd1956b8cb006b50d20805e70757fb00bd60a68b64a1917c7b557455002e0" exitCode=0 Sep 08 06:34:51.737477 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.737008 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" event={"ID":"310c63446c4dc1a1ade4a56efe09d277","Type":"ContainerDied","Data":"818bd1956b8cb006b50d20805e70757fb00bd60a68b64a1917c7b557455002e0"} Sep 08 06:34:51.745043 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.744984 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" event={"ID":"1c749b6c2a01b1fce303e8fb7539e8c0","Type":"ContainerStarted","Data":"7e4e0d8cdfbc68228369fabf1a4d051f62e0317f5a6430c00157b63532081895"} Sep 08 06:34:51.749804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.749737 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vct6x" event={"ID":"6b861c3d-3342-4009-ae7c-ec909768e808","Type":"ContainerStarted","Data":"e18743b05561718f531c58fcfe154bdd165fc3c1c8e3bc408cfa127aa4d2ae7b"} Sep 08 06:34:51.761970 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.761939 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" event={"ID":"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28","Type":"ContainerStarted","Data":"dbce00ae2c1f1988561697a83965e5b8ac54351dce5cab28bf6ef511b8258cab"} Sep 08 06:34:51.768081 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.768047 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv46b" event={"ID":"e9411fc0-ebff-49fc-8121-b0a986212212","Type":"ContainerStarted","Data":"851ebe4a7bfb3a9f5aa59976a00cff647422df208b38b2f930e539292f81496c"} Sep 08 06:34:51.785577 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.785534 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vj5sv" event={"ID":"774f36e1-bcfc-47fd-a383-86d332d68292","Type":"ContainerStarted","Data":"b948fc38e946501082646500f4b53fa1b52d0b17280ed8209871a7b49c8bf11b"} Sep 08 06:34:51.830059 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:51.829932 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhsr2" event={"ID":"328b049c-7a58-48a1-b835-472bf306f6b8","Type":"ContainerStarted","Data":"a89f342342f4b50d7e085a04495b297c6309f0d8f9eeddb932aa5b766337d3e6"} Sep 08 06:34:52.870780 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:52.867769 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" event={"ID":"310c63446c4dc1a1ade4a56efe09d277","Type":"ContainerStarted","Data":"1a840e81b8a90655e1b4427fba1ec46019d4cbbd85d3cdd630250a0327d610ea"} Sep 08 06:34:52.883931 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:52.883879 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-183.ec2.internal" podStartSLOduration=4.883861366 podStartE2EDuration="4.883861366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:34:51.768293254 +0000 UTC m=+4.577401835" watchObservedRunningTime="2026-09-08 06:34:52.883861366 +0000 UTC m=+5.692969949" Sep 08 06:34:53.257425 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.257339 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:53.257632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.257460 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:53.257632 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.257603 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:53.257632 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.257627 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:53.257812 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.257641 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:53.257812 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.257698 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.257680473 +0000 UTC m=+10.066789034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:53.258134 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.258114 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:53.258191 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.258175 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.258158821 +0000 UTC m=+10.067267383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:53.358780 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.358214 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:53.358780 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.358357 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:53.358780 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.358417 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.358399793 +0000 UTC m=+10.167508362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:53.682869 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.682834 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:53.683054 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.682974 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:53.683414 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.683393 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:53.683519 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.683501 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:34:53.683813 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:53.683793 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:53.683966 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:53.683905 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:55.682847 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:55.682814 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:55.683334 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:55.682958 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:55.683423 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:55.683346 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:55.683476 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:55.683441 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:55.683528 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:55.683492 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:55.683579 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:55.683558 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.290744 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.291057 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.290991 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.291172 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.291237 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:35:05.291217234 +0000 UTC m=+18.100325794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.291172 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.291270 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:57.291613 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.291328 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:35:05.29131564 +0000 UTC m=+18.100424198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:57.391466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.391400 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:57.391648 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.391524 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:57.391648 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.391589 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:05.391571701 +0000 UTC m=+18.200680272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:57.682813 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.682676 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:57.683604 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.683580 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:57.683735 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.683668 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:57.683794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:57.683737 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:57.683858 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.683793 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:57.683858 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:57.683841 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:59.682853 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:59.682975 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:59.683036 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:59.683115 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:34:59.683454 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:34:59.683591 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:34:59.683547 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:01.682566 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:01.682480 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:01.683052 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:01.682487 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:01.683052 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:01.682621 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:01.683052 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:01.682643 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:01.683052 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:01.682727 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:01.683052 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:01.682793 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:03.682271 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:03.682236 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:03.682271 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:03.682274 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:03.682761 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:03.682236 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:03.682761 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:03.682375 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:03.682761 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:03.682449 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:03.682761 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:03.682498 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:05.351692 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.351654 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.351701 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351828 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351851 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351861 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351863 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351912 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:35:21.351898912 +0000 UTC m=+34.161007469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:05.352146 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.351927 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:35:21.351920285 +0000 UTC m=+34.161028843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:05.452769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.452720 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:05.452939 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.452848 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:05.452939 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.452918 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:21.452896527 +0000 UTC m=+34.262005090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:05.682382 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.682291 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:05.682535 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.682291 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:05.682535 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.682425 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:05.682535 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:05.682296 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:05.682748 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.682534 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:05.682748 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:05.682597 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:07.684377 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:07.684339 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:07.684846 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:07.684525 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:07.685616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:07.685478 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:07.685766 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:07.685619 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:07.685766 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:07.685653 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:07.686121 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:07.686086 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:08.902230 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.902175 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vj5sv" event={"ID":"774f36e1-bcfc-47fd-a383-86d332d68292","Type":"ContainerStarted","Data":"f3bb2130691a6c4edda3580d4b854dac992d26231284cf98a4957a969be6d04b"} Sep 08 06:35:08.906789 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.906568 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhsr2" event={"ID":"328b049c-7a58-48a1-b835-472bf306f6b8","Type":"ContainerStarted","Data":"55110d63230472ae657afbffcb07718f2e39607d59e7bec4a3202814839a9af2"} Sep 08 06:35:08.909971 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.909655 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" event={"ID":"e6c7a368-f33a-49c7-a8b0-faa625a90a51","Type":"ContainerStarted","Data":"c341af233e62ee53b3e43d1ab7f0bbeceb82169f0d6e5bc5a25bd4922370263d"} Sep 08 06:35:08.912323 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.912205 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"4b8d0b74057fcb48281553ef3de8f07d41ba73a1b0a128ad14527eabb94913f1"} Sep 08 06:35:08.913999 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.913941 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv46b" event={"ID":"e9411fc0-ebff-49fc-8121-b0a986212212","Type":"ContainerStarted","Data":"b41ee2194f6f421aaa3217b87bc969b1c3c510b85c98302431c942e46df908b5"} Sep 08 06:35:08.919279 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.919227 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vj5sv" podStartSLOduration=11.428201926 podStartE2EDuration="21.919208178s" totalImagesPullingTime="10.491006252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:08.918927967 +0000 UTC m=+21.728036549" watchObservedRunningTime="2026-09-08 06:35:08.919208178 +0000 UTC m=+21.728316760" Sep 08 06:35:08.922534 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.922373 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-183.ec2.internal" podStartSLOduration=20.92236156 podStartE2EDuration="20.92236156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:34:52.884114161 +0000 UTC m=+5.693222743" watchObservedRunningTime="2026-09-08 06:35:08.92236156 +0000 UTC m=+21.731470137" Sep 08 06:35:08.974867 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.974808 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhsr2" podStartSLOduration=4.189295415 podStartE2EDuration="21.974785951s" totalImagesPullingTime="17.785490536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:08.946552211 +0000 UTC m=+21.755660792" watchObservedRunningTime="2026-09-08 06:35:08.974785951 +0000 UTC m=+21.783894533" Sep 08 06:35:08.975113 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.975080 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2n9tm" podStartSLOduration=4.242139391 podStartE2EDuration="21.975070892s" totalImagesPullingTime="17.732931501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:08.974510482 +0000 UTC m=+21.783619044" watchObservedRunningTime="2026-09-08 06:35:08.975070892 +0000 UTC m=+21.784179473" Sep 08 06:35:08.990887 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:08.990732 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jv46b" podStartSLOduration=11.491773591 podStartE2EDuration="21.990700609s" totalImagesPullingTime="10.498927018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:08.990440752 +0000 UTC m=+21.799549334" watchObservedRunningTime="2026-09-08 06:35:08.990700609 +0000 UTC m=+21.799809192" Sep 08 06:35:09.682198 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.681989 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:09.682409 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:09.682302 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:09.682409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.682020 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:09.682409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.681995 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:09.682577 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:09.682407 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:09.682577 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:09.682471 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:09.917728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.917682 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vct6x" event={"ID":"6b861c3d-3342-4009-ae7c-ec909768e808","Type":"ContainerStarted","Data":"9d9b30c72f89cf5e0df0138e68ab75cdd1572ed8c7fa6b0afe9ce99f0944fc12"} Sep 08 06:35:09.919540 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.919512 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" event={"ID":"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28","Type":"ContainerStarted","Data":"47a2e0e1797cde0737f6357e80831066ad16dfa0830001ff3d119dc4d57bcceb"} Sep 08 06:35:09.921336 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.921288 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="b26816b0bd93c350d744638f84ac0cb6c20d9892d5a7e1043eebcfe7faa31343" exitCode=0 Sep 08 06:35:09.921443 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.921365 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"b26816b0bd93c350d744638f84ac0cb6c20d9892d5a7e1043eebcfe7faa31343"} Sep 08 06:35:09.928025 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.928001 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"0cc20ee88c4b6116d79b48ae02720c07e19f9b996e7de4c0bdbf9829649f72f5"} Sep 08 06:35:09.928217 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.928186 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"fbff069a4582914bbcf1b79413a5fb3ea4d978f69f92c106d98b9153334cbc0f"} Sep 08 06:35:09.928326 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.928236 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"ff14f87e2fb2070b3edaa8c4a431f91f13cce8cd577380ebe07d0548d0eeeffc"} Sep 08 06:35:09.928326 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.928270 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"ee08feffd3b90de31ffd90a9d1b91d67779e54bde435d0e8ff9b205587043b9e"} Sep 08 06:35:09.928326 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.928304 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"268f764b74f0399ba7404e787291ae8612bfeafc5b95eb094a449744db196444"} Sep 08 06:35:09.933112 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:09.933012 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vct6x" podStartSLOduration=5.202800129 podStartE2EDuration="22.93299983s" totalImagesPullingTime="17.730199701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:09.932524449 +0000 UTC m=+22.741633038" watchObservedRunningTime="2026-09-08 06:35:09.93299983 +0000 UTC m=+22.742108409" Sep 08 06:35:10.122096 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.122060 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:35:10.122752 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.122730 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:35:10.498818 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.498795 2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 06:35:10.675948 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.675774 2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T06:35:10.498813467Z","UUID":"d42af453-69bf-4709-8266-b46112dae5d7","Handler":null,"Name":"","Endpoint":""} Sep 08 06:35:10.678096 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.678052 2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 06:35:10.678096 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.678089 2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 06:35:10.932641 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.932235 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bbqf" event={"ID":"8b5a0a08-bad3-43d2-a7df-28cca89688b7","Type":"ContainerStarted","Data":"e066d47b86edb6c1fb0d79ad9776f267602017c01181459a19fd22ec035e4d4d"} Sep 08 06:35:10.934372 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:10.934340 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" event={"ID":"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28","Type":"ContainerStarted","Data":"8245c2a8c08b9839300957d04269e33cd8e998a45e4d8150a793e50bc8d38c88"} Sep 08 06:35:11.686087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.685995 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:11.686087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.686013 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:11.686299 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:11.686127 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:11.686299 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:11.686189 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:11.686299 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.686230 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:11.686444 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:11.686318 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:11.938934 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.938848 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" event={"ID":"ec53fdcf-d5a7-4ace-bafa-ce3837d1da28","Type":"ContainerStarted","Data":"465d36e48545233a969f22d3a6bbf01bddfb9a5d3a52993119b8f35bb888dda2"} Sep 08 06:35:11.942833 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.942804 2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:11.942833 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.942812 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"aff46d821371e30551088533f9522c03ac9dd0d1da7d6c22e87dbd571546caa9"} Sep 08 06:35:11.957370 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.957322 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5bbqf" podStartSLOduration=7.2202062 podStartE2EDuration="24.957305114s" totalImagesPullingTime="17.737098914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:10.94834884 +0000 UTC m=+23.757457421" watchObservedRunningTime="2026-09-08 06:35:11.957305114 +0000 UTC m=+24.766413694" Sep 08 06:35:11.957927 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:11.957881 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hs4np" podStartSLOduration=4.901583534 podStartE2EDuration="24.957865859s" totalImagesPullingTime="20.056282325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:11.956487769 +0000 UTC m=+24.765596350" watchObservedRunningTime="2026-09-08 06:35:11.957865859 +0000 UTC m=+24.766974441" Sep 08 06:35:12.267204 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:12.267111 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vj5sv_774f36e1-bcfc-47fd-a383-86d332d68292/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:12.362065 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:12.362028 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vj5sv_774f36e1-bcfc-47fd-a383-86d332d68292/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:13.682262 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:13.682228 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:13.682262 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:13.682271 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:13.682793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:13.682228 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:13.682793 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:13.682385 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:13.682793 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:13.682461 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:13.682793 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:13.682574 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:14.254760 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.254613 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vj5sv_774f36e1-bcfc-47fd-a383-86d332d68292/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:14.384310 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.384284 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vj5sv_774f36e1-bcfc-47fd-a383-86d332d68292/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:14.953795 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.953760 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" event={"ID":"de37eb23-d595-4a79-8a43-5ebe7b6dd062","Type":"ContainerStarted","Data":"0bb84b235167fa0d8ba8470cfabe60e9722fd2785067f59c834d7fc527c4e2bd"} Sep 08 06:35:14.954637 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.953996 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:14.954637 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.954061 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:14.956129 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.956106 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="b8cf6643915b79beab4bdf36ae57d7b6b2fc500b60a312a29a7864282582acdc" exitCode=0 Sep 08 06:35:14.956267 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.956135 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"b8cf6643915b79beab4bdf36ae57d7b6b2fc500b60a312a29a7864282582acdc"} Sep 08 06:35:14.969588 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:14.969568 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:15.023036 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.022987 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" podStartSLOduration=10.23471624 podStartE2EDuration="28.022970976s" totalImagesPullingTime="17.788254736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:14.987486375 +0000 UTC m=+27.796594956" watchObservedRunningTime="2026-09-08 06:35:15.022970976 +0000 UTC m=+27.832079556" Sep 08 06:35:15.682559 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.682528 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:15.682763 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.682532 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:15.682763 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.682662 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:15.682763 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:15.682653 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:15.682930 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:15.682811 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:15.682975 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:15.682922 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:15.961119 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.960954 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="908ed3add0784d7515d4694a6d91d4adaf50d4541f3b5527f84fa69e7313146b" exitCode=0 Sep 08 06:35:15.961442 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.961035 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"908ed3add0784d7515d4694a6d91d4adaf50d4541f3b5527f84fa69e7313146b"} Sep 08 06:35:15.961662 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.961645 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:15.976836 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:15.976811 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:16.175180 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.175145 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fx7b4"] Sep 08 06:35:16.175329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.175248 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:16.175396 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:16.175348 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:16.175853 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.175829 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4pjv"] Sep 08 06:35:16.175946 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.175910 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:16.176028 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:16.176001 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:16.176359 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.176341 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vfqp2"] Sep 08 06:35:16.176425 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.176414 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:16.176513 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:16.176498 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:16.966024 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.965945 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="5be691fbf20d27a4a00cbdc9d74f271492717b0d25bb4af919b7afdae9714e1f" exitCode=0 Sep 08 06:35:16.966350 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:16.966023 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"5be691fbf20d27a4a00cbdc9d74f271492717b0d25bb4af919b7afdae9714e1f"} Sep 08 06:35:17.683835 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:17.683804 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:17.683971 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:17.683929 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:17.684312 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:17.684289 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:17.684443 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:17.684409 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:17.684519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:17.684469 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:17.684568 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:17.684542 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:18.427694 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:18.427650 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:35:18.428102 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:18.427887 2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:18.428285 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:18.428267 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vj5sv" Sep 08 06:35:19.685061 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:19.685031 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:19.685061 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:19.685067 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:19.685563 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:19.685071 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:19.685563 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:19.685214 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vfqp2" podUID="cfb4d491-ae35-479a-85df-e41f06cc209b" Sep 08 06:35:19.685563 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:19.685350 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4pjv" podUID="3a1076f8-b2a3-46f0-b49a-3854a83cd29a" Sep 08 06:35:19.685563 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:19.685441 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fx7b4" podUID="a23c0b0c-4502-432b-90e9-47b49c6fd9b2" Sep 08 06:35:21.363119 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.363098 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.363131 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363230 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363250 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363273 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.363260287 +0000 UTC m=+66.172368845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363273 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363289 2547 projected.go:196] Error preparing data for projected volume kube-api-access-r58fh for pod openshift-network-diagnostics/network-check-target-r4pjv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:21.363470 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.363309 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh podName:3a1076f8-b2a3-46f0-b49a-3854a83cd29a nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.363302569 +0000 UTC m=+66.172411127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r58fh" (UniqueName: "kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh") pod "network-check-target-r4pjv" (UID: "3a1076f8-b2a3-46f0-b49a-3854a83cd29a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:21.463760 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.463699 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:21.463891 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.463832 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:21.463944 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.463903 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret podName:a23c0b0c-4502-432b-90e9-47b49c6fd9b2 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.463883638 +0000 UTC m=+66.272992199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret") pod "global-pull-secret-syncer-fx7b4" (UID: "a23c0b0c-4502-432b-90e9-47b49c6fd9b2") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:21.554182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.554156 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-183.ec2.internal" event="NodeReady" Sep 08 06:35:21.554355 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.554281 2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 06:35:21.627252 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.627225 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ht62t"] Sep 08 06:35:21.644554 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.644531 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hswq2"] Sep 08 06:35:21.644700 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.644657 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.651737 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.651699 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 06:35:21.651737 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.651726 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 06:35:21.651893 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.651814 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jz89\"" Sep 08 06:35:21.658581 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.658560 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hswq2"] Sep 08 06:35:21.658700 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.658657 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.661458 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.661436 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 06:35:21.662337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.662135 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 06:35:21.662337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.662163 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 06:35:21.662483 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.662369 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ht62t"] Sep 08 06:35:21.662530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.662520 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qjzjr\"" Sep 08 06:35:21.682586 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.682566 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:21.682586 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.682585 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:21.682759 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.682698 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:21.686519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686498 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jhmvb\"" Sep 08 06:35:21.686601 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686502 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 06:35:21.686659 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686613 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 06:35:21.686729 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686681 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 06:35:21.686786 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686758 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 06:35:21.686926 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.686912 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rcs59\"" Sep 08 06:35:21.765388 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765335 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d088f935-aa9c-4f71-a655-a17741bc90aa-tmp-dir\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.765388 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765362 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn49n\" (UniqueName: \"kubernetes.io/projected/d088f935-aa9c-4f71-a655-a17741bc90aa-kube-api-access-bn49n\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.765542 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765394 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8r4\" (UniqueName: \"kubernetes.io/projected/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-kube-api-access-5p8r4\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.765542 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765501 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.765609 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765553 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-cert\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.765609 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.765584 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d088f935-aa9c-4f71-a655-a17741bc90aa-config-volume\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866186 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866147 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-cert\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.866409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866193 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d088f935-aa9c-4f71-a655-a17741bc90aa-config-volume\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866241 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d088f935-aa9c-4f71-a655-a17741bc90aa-tmp-dir\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866262 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn49n\" (UniqueName: \"kubernetes.io/projected/d088f935-aa9c-4f71-a655-a17741bc90aa-kube-api-access-bn49n\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866293 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8r4\" (UniqueName: \"kubernetes.io/projected/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-kube-api-access-5p8r4\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.866409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866338 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866610 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.866509 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:21.866610 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:21.866602 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:22.366578263 +0000 UTC m=+35.175686840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:21.866694 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866660 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d088f935-aa9c-4f71-a655-a17741bc90aa-tmp-dir\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.866934 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.866917 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d088f935-aa9c-4f71-a655-a17741bc90aa-config-volume\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.870561 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.870531 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-cert\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.885010 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.884982 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn49n\" (UniqueName: \"kubernetes.io/projected/d088f935-aa9c-4f71-a655-a17741bc90aa-kube-api-access-bn49n\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:21.885350 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.885327 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8r4\" (UniqueName: \"kubernetes.io/projected/dd6cfa9a-5237-4b6c-bd3f-b673074428ae-kube-api-access-5p8r4\") pod \"ingress-canary-hswq2\" (UID: \"dd6cfa9a-5237-4b6c-bd3f-b673074428ae\") " pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.967507 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.967470 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hswq2" Sep 08 06:35:21.981273 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.981240 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="0abeedf96c98357360ebd44899df4a2914709ff169f0b7a7299c045dbd61ca41" exitCode=0 Sep 08 06:35:21.981407 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:21.981290 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"0abeedf96c98357360ebd44899df4a2914709ff169f0b7a7299c045dbd61ca41"} Sep 08 06:35:22.284632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:22.284595 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hswq2"] Sep 08 06:35:22.288492 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:22.288459 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6cfa9a_5237_4b6c_bd3f_b673074428ae.slice/crio-12c882e9f53b8e1f7518a5316ee784d8a58f18c9f279cfc670922cd69d9a56d7 WatchSource:0}: Error finding container 12c882e9f53b8e1f7518a5316ee784d8a58f18c9f279cfc670922cd69d9a56d7: Status 404 returned error can't find the container with id 12c882e9f53b8e1f7518a5316ee784d8a58f18c9f279cfc670922cd69d9a56d7 Sep 08 06:35:22.369863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:22.369832 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:22.370621 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:22.369972 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:22.370621 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:22.370045 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:23.37002527 +0000 UTC m=+36.179133848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:22.988059 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:22.988027 2547 generic.go:356] "Generic (PLEG): container finished" podID="bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1" containerID="0231875015a54f4fddc23471efe1bea11cc8f624f90d49069b583e441ba03307" exitCode=0 Sep 08 06:35:22.988288 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:22.988110 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerDied","Data":"0231875015a54f4fddc23471efe1bea11cc8f624f90d49069b583e441ba03307"} Sep 08 06:35:22.989494 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:22.989421 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hswq2" event={"ID":"dd6cfa9a-5237-4b6c-bd3f-b673074428ae","Type":"ContainerStarted","Data":"12c882e9f53b8e1f7518a5316ee784d8a58f18c9f279cfc670922cd69d9a56d7"} Sep 08 06:35:23.377262 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:23.377215 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:23.377679 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:23.377381 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:23.377679 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:23.377443 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:25.377426419 +0000 UTC m=+38.186535000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:23.996866 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:23.996828 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" event={"ID":"bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1","Type":"ContainerStarted","Data":"b05abd50a0f6abfdca32783c4c1dd1fcfba33c73bc246bf08b92045549024314"} Sep 08 06:35:24.024743 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:24.024549 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hx5ks" podStartSLOduration=9.136689527 podStartE2EDuration="37.024534104s" totalImagesPullingTime="27.887844577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:24.024259444 +0000 UTC m=+36.833368024" watchObservedRunningTime="2026-09-08 06:35:24.024534104 +0000 UTC m=+36.833642683" Sep 08 06:35:25.003079 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:25.003038 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hswq2" event={"ID":"dd6cfa9a-5237-4b6c-bd3f-b673074428ae","Type":"ContainerStarted","Data":"ff355c0efd84f0669e9dcc89d57e6098013e6efb853bf5ea9d3f2741eefd6d4b"} Sep 08 06:35:25.022644 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:25.022596 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hswq2" podStartSLOduration=1.507946317 podStartE2EDuration="4.022578021s" totalImagesPullingTime="2.514631704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:25.021592027 +0000 UTC m=+37.830700607" watchObservedRunningTime="2026-09-08 06:35:25.022578021 +0000 UTC m=+37.831686600" Sep 08 06:35:25.394315 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:25.394087 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:25.394315 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:25.394232 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:25.394504 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:25.394334 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:29.394316774 +0000 UTC m=+42.203425337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:29.421468 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:29.421426 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:29.421861 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:29.421605 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:29.421861 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:29.421680 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:37.421660211 +0000 UTC m=+50.230768770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:37.475955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:37.475909 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:37.476331 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:37.476059 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:37.476331 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:37.476117 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.4761015 +0000 UTC m=+66.285210063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:46.750324 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.750282 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vgqkd"] Sep 08 06:35:46.753411 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.753394 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.756241 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.756076 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 08 06:35:46.757060 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.757030 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:35:46.757294 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.757269 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lbz6s\"" Sep 08 06:35:46.757527 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.757504 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 08 06:35:46.760764 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.760741 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 08 06:35:46.765963 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.765943 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 08 06:35:46.769725 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.769689 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vgqkd"] Sep 08 06:35:46.841544 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.841503 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wll2z\" (UniqueName: \"kubernetes.io/projected/bfde7c97-51ad-4149-a800-12d32ea22d84-kube-api-access-wll2z\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.841760 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.841580 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-config\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.841760 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.841606 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfde7c97-51ad-4149-a800-12d32ea22d84-serving-cert\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.841760 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.841732 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-trusted-ca\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.857458 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.857429 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7ccd684956-xcbxb"] Sep 08 06:35:46.859466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.859451 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:46.863814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.863789 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 08 06:35:46.863965 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.863944 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 08 06:35:46.864034 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.864022 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgvq6\"" Sep 08 06:35:46.865621 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.865598 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 08 06:35:46.865820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.865798 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 08 06:35:46.865936 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.865895 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 08 06:35:46.865998 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.865942 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 08 06:35:46.875552 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.875528 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ccd684956-xcbxb"] Sep 08 06:35:46.942252 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.942216 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-config\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.942252 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.942251 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfde7c97-51ad-4149-a800-12d32ea22d84-serving-cert\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.942512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.942294 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-trusted-ca\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.942512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.942332 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wll2z\" (UniqueName: \"kubernetes.io/projected/bfde7c97-51ad-4149-a800-12d32ea22d84-kube-api-access-wll2z\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.943025 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.943001 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-config\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.943226 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.943206 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfde7c97-51ad-4149-a800-12d32ea22d84-trusted-ca\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.946144 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.946123 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfde7c97-51ad-4149-a800-12d32ea22d84-serving-cert\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:46.955126 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:46.955100 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wll2z\" (UniqueName: \"kubernetes.io/projected/bfde7c97-51ad-4149-a800-12d32ea22d84-kube-api-access-wll2z\") pod \"console-operator-85b454874b-vgqkd\" (UID: \"bfde7c97-51ad-4149-a800-12d32ea22d84\") " pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:47.043054 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.043017 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.043221 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.043144 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-default-certificate\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.043221 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.043210 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.043306 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.043232 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg7dz\" (UniqueName: \"kubernetes.io/projected/116cf422-4f03-420b-8080-27e0313c0a2f-kube-api-access-cg7dz\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.043306 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.043258 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-stats-auth\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.063922 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.063885 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:47.144151 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.144122 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.144312 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.144157 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg7dz\" (UniqueName: \"kubernetes.io/projected/116cf422-4f03-420b-8080-27e0313c0a2f-kube-api-access-cg7dz\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.144312 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.144188 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-stats-auth\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.144312 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.144208 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.144312 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.144283 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 06:35:47.144312 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.144315 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:47.644298226 +0000 UTC m=+60.453406805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:35:47.144592 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.144340 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:47.644322916 +0000 UTC m=+60.453431474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : secret "router-metrics-certs-default" not found Sep 08 06:35:47.144592 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.144397 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-default-certificate\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.146800 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.146773 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-default-certificate\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.146911 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.146773 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-stats-auth\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.154643 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.154622 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg7dz\" (UniqueName: \"kubernetes.io/projected/116cf422-4f03-420b-8080-27e0313c0a2f-kube-api-access-cg7dz\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.334754 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.334644 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-vgqkd"] Sep 08 06:35:47.339351 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:47.339315 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfde7c97_51ad_4149_a800_12d32ea22d84.slice/crio-df179f433f9fb88eb8c93f2544935dcd0611aac494bba0ef346374bdc39c88ec WatchSource:0}: Error finding container df179f433f9fb88eb8c93f2544935dcd0611aac494bba0ef346374bdc39c88ec: Status 404 returned error can't find the container with id df179f433f9fb88eb8c93f2544935dcd0611aac494bba0ef346374bdc39c88ec Sep 08 06:35:47.649396 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.649325 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.649535 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.649469 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:47.649535 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.649498 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:48.649480255 +0000 UTC m=+61.458588813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:35:47.649664 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.649546 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 06:35:47.649664 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:47.649591 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:48.64957773 +0000 UTC m=+61.458686302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : secret "router-metrics-certs-default" not found Sep 08 06:35:47.978586 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:47.978508 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2zbx9" Sep 08 06:35:48.058243 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:48.058209 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" event={"ID":"bfde7c97-51ad-4149-a800-12d32ea22d84","Type":"ContainerStarted","Data":"df179f433f9fb88eb8c93f2544935dcd0611aac494bba0ef346374bdc39c88ec"} Sep 08 06:35:48.658794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:48.658752 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:48.658984 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:48.658893 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:48.658984 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:48.658936 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:50.658916205 +0000 UTC m=+63.468024770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:35:48.659118 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:48.659025 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 06:35:48.659118 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:48.659087 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:50.659070656 +0000 UTC m=+63.468179229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : secret "router-metrics-certs-default" not found Sep 08 06:35:50.064954 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.064923 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/0.log" Sep 08 06:35:50.065402 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.064967 2547 generic.go:356] "Generic (PLEG): container finished" podID="bfde7c97-51ad-4149-a800-12d32ea22d84" containerID="a7b3bddc51927dc50405f4cded697d76bf3be8ae377662227811aabeae9aafc2" exitCode=255 Sep 08 06:35:50.065402 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.065030 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" event={"ID":"bfde7c97-51ad-4149-a800-12d32ea22d84","Type":"ContainerDied","Data":"a7b3bddc51927dc50405f4cded697d76bf3be8ae377662227811aabeae9aafc2"} Sep 08 06:35:50.065402 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.065321 2547 scope.go:117] "RemoveContainer" containerID="a7b3bddc51927dc50405f4cded697d76bf3be8ae377662227811aabeae9aafc2" Sep 08 06:35:50.676125 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.676066 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:50.676125 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:50.676133 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:50.676346 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:50.676240 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:54.676226898 +0000 UTC m=+67.485335455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:35:50.676346 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:50.676240 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 06:35:50.676346 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:50.676301 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:35:54.67628631 +0000 UTC m=+67.485394869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : secret "router-metrics-certs-default" not found Sep 08 06:35:51.069380 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.069352 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:35:51.069840 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.069824 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/0.log" Sep 08 06:35:51.069885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.069859 2547 generic.go:356] "Generic (PLEG): container finished" podID="bfde7c97-51ad-4149-a800-12d32ea22d84" containerID="27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840" exitCode=255 Sep 08 06:35:51.069915 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.069884 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" event={"ID":"bfde7c97-51ad-4149-a800-12d32ea22d84","Type":"ContainerDied","Data":"27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840"} Sep 08 06:35:51.069947 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.069926 2547 scope.go:117] "RemoveContainer" containerID="a7b3bddc51927dc50405f4cded697d76bf3be8ae377662227811aabeae9aafc2" Sep 08 06:35:51.070154 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.070140 2547 scope.go:117] "RemoveContainer" containerID="27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840" Sep 08 06:35:51.070343 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:51.070320 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vgqkd_openshift-console-operator(bfde7c97-51ad-4149-a800-12d32ea22d84)\"" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" podUID="bfde7c97-51ad-4149-a800-12d32ea22d84" Sep 08 06:35:51.623471 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.623437 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-77plq"] Sep 08 06:35:51.628485 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.628467 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.634666 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.634634 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 06:35:51.634779 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.634681 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 06:35:51.634938 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.634923 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fp5c6\"" Sep 08 06:35:51.635277 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.635263 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 06:35:51.635345 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.635264 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 06:35:51.655781 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.655743 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77plq"] Sep 08 06:35:51.784464 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.784420 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.784646 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.784581 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bd49282-0656-4f25-9f76-0405f523131c-data-volume\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.784646 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.784625 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qntv\" (UniqueName: \"kubernetes.io/projected/6bd49282-0656-4f25-9f76-0405f523131c-kube-api-access-2qntv\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.784775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.784676 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bd49282-0656-4f25-9f76-0405f523131c-crio-socket\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.784775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.784692 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.885914 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.885827 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.885925 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bd49282-0656-4f25-9f76-0405f523131c-data-volume\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.885968 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qntv\" (UniqueName: \"kubernetes.io/projected/6bd49282-0656-4f25-9f76-0405f523131c-kube-api-access-2qntv\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:51.885983 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.886018 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bd49282-0656-4f25-9f76-0405f523131c-crio-socket\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.886042 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886074 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:51.886059 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:52.386039383 +0000 UTC m=+65.195147960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:51.886333 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:51.886154 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:51.886333 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.886218 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bd49282-0656-4f25-9f76-0405f523131c-crio-socket\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.886333 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:51.886230 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:52.386214093 +0000 UTC m=+65.195322652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : configmap "kube-rbac-proxy" not found Sep 08 06:35:51.886333 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.886310 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bd49282-0656-4f25-9f76-0405f523131c-data-volume\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:51.898848 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:51.898822 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qntv\" (UniqueName: \"kubernetes.io/projected/6bd49282-0656-4f25-9f76-0405f523131c-kube-api-access-2qntv\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:52.074103 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.074079 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:35:52.074597 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.074462 2547 scope.go:117] "RemoveContainer" containerID="27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840" Sep 08 06:35:52.074685 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:52.074660 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vgqkd_openshift-console-operator(bfde7c97-51ad-4149-a800-12d32ea22d84)\"" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" podUID="bfde7c97-51ad-4149-a800-12d32ea22d84" Sep 08 06:35:52.390160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.390114 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:52.390395 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.390177 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:52.390395 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:52.390241 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:52.390395 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:52.390277 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:52.390395 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:52.390314 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.390297169 +0000 UTC m=+66.199405726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : configmap "kube-rbac-proxy" not found Sep 08 06:35:52.390395 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:52.390330 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.390323467 +0000 UTC m=+66.199432025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:52.477306 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.477270 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds"] Sep 08 06:35:52.500840 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.500814 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds"] Sep 08 06:35:52.500990 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.500909 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" Sep 08 06:35:52.503518 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.503493 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 08 06:35:52.503633 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.503493 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 08 06:35:52.503934 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.503920 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4w7mc\"" Sep 08 06:35:52.591670 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.591631 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfpvt\" (UniqueName: \"kubernetes.io/projected/92a51117-e9ca-4e1c-83ad-aae082a7a561-kube-api-access-wfpvt\") pod \"migrator-fdbb8fdff-q5xds\" (UID: \"92a51117-e9ca-4e1c-83ad-aae082a7a561\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" Sep 08 06:35:52.692023 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.691936 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfpvt\" (UniqueName: \"kubernetes.io/projected/92a51117-e9ca-4e1c-83ad-aae082a7a561-kube-api-access-wfpvt\") pod \"migrator-fdbb8fdff-q5xds\" (UID: \"92a51117-e9ca-4e1c-83ad-aae082a7a561\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" Sep 08 06:35:52.700209 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.700178 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfpvt\" (UniqueName: \"kubernetes.io/projected/92a51117-e9ca-4e1c-83ad-aae082a7a561-kube-api-access-wfpvt\") pod \"migrator-fdbb8fdff-q5xds\" (UID: \"92a51117-e9ca-4e1c-83ad-aae082a7a561\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" Sep 08 06:35:52.809253 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.809218 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" Sep 08 06:35:52.895063 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.895035 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l54jb"] Sep 08 06:35:52.917032 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.917007 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l54jb"] Sep 08 06:35:52.917179 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.917109 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:52.919814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.919789 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 08 06:35:52.919980 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.919789 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 08 06:35:52.919980 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.919881 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 08 06:35:52.920167 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.920153 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 08 06:35:52.920254 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.920238 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cqzpn\"" Sep 08 06:35:52.994173 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.994088 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-key\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:52.994173 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.994125 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbws6\" (UniqueName: \"kubernetes.io/projected/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-kube-api-access-mbws6\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:52.994346 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:52.994235 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-cabundle\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.093978 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.093947 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds"] Sep 08 06:35:53.095044 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.095020 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-key\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.095160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.095053 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbws6\" (UniqueName: \"kubernetes.io/projected/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-kube-api-access-mbws6\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.095160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.095130 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-cabundle\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.095754 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.095736 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-cabundle\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.097271 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:53.097249 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a51117_e9ca_4e1c_83ad_aae082a7a561.slice/crio-b9f5c453675da35d8f345a9131f758c19b8bb654a89cd37a6fc794bb12496bf8 WatchSource:0}: Error finding container b9f5c453675da35d8f345a9131f758c19b8bb654a89cd37a6fc794bb12496bf8: Status 404 returned error can't find the container with id b9f5c453675da35d8f345a9131f758c19b8bb654a89cd37a6fc794bb12496bf8 Sep 08 06:35:53.097352 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.097321 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-signing-key\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.104866 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.104846 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbws6\" (UniqueName: \"kubernetes.io/projected/8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146-kube-api-access-mbws6\") pod \"service-ca-75d99c484-l54jb\" (UID: \"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146\") " pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.226255 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.226219 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-l54jb" Sep 08 06:35:53.397818 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.397783 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:35:53.398016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.397907 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:53.398016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.397948 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:53.398016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.397980 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:53.398182 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.398027 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:53.398182 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.398089 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:53.398182 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.398099 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:55.398076225 +0000 UTC m=+68.207184793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : configmap "kube-rbac-proxy" not found Sep 08 06:35:53.398182 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.398140 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:55.398124112 +0000 UTC m=+68.207232685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:53.401048 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.401027 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 06:35:53.401089 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.401066 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 06:35:53.408143 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.408118 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 06:35:53.408261 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.408182 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs podName:cfb4d491-ae35-479a-85df-e41f06cc209b nodeName:}" failed. No retries permitted until 2026-09-08 06:36:57.408162719 +0000 UTC m=+130.217271279 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs") pod "network-metrics-daemon-vfqp2" (UID: "cfb4d491-ae35-479a-85df-e41f06cc209b") : secret "metrics-daemon-secret" not found Sep 08 06:35:53.410388 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.410368 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 06:35:53.420752 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.420737 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58fh\" (UniqueName: \"kubernetes.io/projected/3a1076f8-b2a3-46f0-b49a-3854a83cd29a-kube-api-access-r58fh\") pod \"network-check-target-r4pjv\" (UID: \"3a1076f8-b2a3-46f0-b49a-3854a83cd29a\") " pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:53.494860 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.494838 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jhmvb\"" Sep 08 06:35:53.499254 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.499237 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:35:53.499320 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.499291 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:53.499389 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.499374 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:53.499426 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:53.499419 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls podName:d088f935-aa9c-4f71-a655-a17741bc90aa nodeName:}" failed. No retries permitted until 2026-09-08 06:36:25.499407726 +0000 UTC m=+98.308516289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls") pod "dns-default-ht62t" (UID: "d088f935-aa9c-4f71-a655-a17741bc90aa") : secret "dns-default-metrics-tls" not found Sep 08 06:35:53.502189 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.502162 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:35:53.503163 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.503124 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 06:35:53.512172 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.512155 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a23c0b0c-4502-432b-90e9-47b49c6fd9b2-original-pull-secret\") pod \"global-pull-secret-syncer-fx7b4\" (UID: \"a23c0b0c-4502-432b-90e9-47b49c6fd9b2\") " pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:53.548010 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.547811 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-l54jb"] Sep 08 06:35:53.554322 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:53.552388 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4cf0ca_2941_4a24_8bf9_c4f1f87d2146.slice/crio-33c4adc98619285686c743d0cc25c3970a05686ffca1ae5601df97a9e9227836 WatchSource:0}: Error finding container 33c4adc98619285686c743d0cc25c3970a05686ffca1ae5601df97a9e9227836: Status 404 returned error can't find the container with id 33c4adc98619285686c743d0cc25c3970a05686ffca1ae5601df97a9e9227836 Sep 08 06:35:53.761781 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.761693 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vct6x_6b861c3d-3342-4009-ae7c-ec909768e808/dns-node-resolver/0.log" Sep 08 06:35:53.783314 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.783235 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4pjv"] Sep 08 06:35:53.788660 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:53.788629 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1076f8_b2a3_46f0_b49a_3854a83cd29a.slice/crio-416611ea5156cc58f93b6fef5384b873afd6d038ae761df8587b284b32652b06 WatchSource:0}: Error finding container 416611ea5156cc58f93b6fef5384b873afd6d038ae761df8587b284b32652b06: Status 404 returned error can't find the container with id 416611ea5156cc58f93b6fef5384b873afd6d038ae761df8587b284b32652b06 Sep 08 06:35:53.797641 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:53.797615 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fx7b4" Sep 08 06:35:54.079570 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.079540 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fx7b4"] Sep 08 06:35:54.082578 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.082548 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l54jb" event={"ID":"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146","Type":"ContainerStarted","Data":"33c4adc98619285686c743d0cc25c3970a05686ffca1ae5601df97a9e9227836"} Sep 08 06:35:54.084057 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.084034 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" event={"ID":"92a51117-e9ca-4e1c-83ad-aae082a7a561","Type":"ContainerStarted","Data":"b9f5c453675da35d8f345a9131f758c19b8bb654a89cd37a6fc794bb12496bf8"} Sep 08 06:35:54.085442 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.085419 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4pjv" event={"ID":"3a1076f8-b2a3-46f0-b49a-3854a83cd29a","Type":"ContainerStarted","Data":"416611ea5156cc58f93b6fef5384b873afd6d038ae761df8587b284b32652b06"} Sep 08 06:35:54.173906 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:35:54.173869 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23c0b0c_4502_432b_90e9_47b49c6fd9b2.slice/crio-08c03cd0db4048c4088446861b6246fcdd66da104709237fbe4376c915e85b0b WatchSource:0}: Error finding container 08c03cd0db4048c4088446861b6246fcdd66da104709237fbe4376c915e85b0b: Status 404 returned error can't find the container with id 08c03cd0db4048c4088446861b6246fcdd66da104709237fbe4376c915e85b0b Sep 08 06:35:54.708198 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.708158 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:54.708391 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.708224 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:35:54.708391 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:54.708325 2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 06:35:54.708391 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:54.708359 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:36:02.708337446 +0000 UTC m=+75.517446028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:35:54.708391 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:54.708378 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:36:02.708370911 +0000 UTC m=+75.517479469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : secret "router-metrics-certs-default" not found Sep 08 06:35:54.745856 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:54.745829 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv46b_e9411fc0-ebff-49fc-8121-b0a986212212/node-ca/0.log" Sep 08 06:35:55.091764 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.091677 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" event={"ID":"92a51117-e9ca-4e1c-83ad-aae082a7a561","Type":"ContainerStarted","Data":"b043ee0be05dfcf242a316fc735841ca4e1a61c14bd474bca9514e6df1a99a3b"} Sep 08 06:35:55.092008 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.091814 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" event={"ID":"92a51117-e9ca-4e1c-83ad-aae082a7a561","Type":"ContainerStarted","Data":"85e9b434bdf7d89d8d2cafa90ba6f9c2ffe22890bfbf5584bfaf96e399a1b25b"} Sep 08 06:35:55.093197 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.093165 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fx7b4" event={"ID":"a23c0b0c-4502-432b-90e9-47b49c6fd9b2","Type":"ContainerStarted","Data":"08c03cd0db4048c4088446861b6246fcdd66da104709237fbe4376c915e85b0b"} Sep 08 06:35:55.113540 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.113477 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-q5xds" podStartSLOduration=1.996890659 podStartE2EDuration="3.113455387s" totalImagesPullingTime="1.116564728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:55.11169221 +0000 UTC m=+67.920800789" watchObservedRunningTime="2026-09-08 06:35:55.113455387 +0000 UTC m=+67.922563970" Sep 08 06:35:55.413540 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.413449 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:55.413540 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.413516 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:55.414097 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:55.413646 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:55.414097 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:55.413663 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:55.414097 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:55.413742 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.413725045 +0000 UTC m=+72.222833623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:55.414097 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:55.413762 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.413752209 +0000 UTC m=+72.222860769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : configmap "kube-rbac-proxy" not found Sep 08 06:35:55.549883 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:55.549847 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hswq2_dd6cfa9a-5237-4b6c-bd3f-b673074428ae/serve-healthcheck-canary/0.log" Sep 08 06:35:56.098218 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:56.098158 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-l54jb" event={"ID":"8b4cf0ca-2941-4a24-8bf9-c4f1f87d2146","Type":"ContainerStarted","Data":"a9b6066443e5776bccd168c58ac55284acc07caea56814bcc3051b6ee1707bc3"} Sep 08 06:35:56.118704 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:56.118640 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-l54jb" podStartSLOduration=2.081534565 podStartE2EDuration="4.118621892s" totalImagesPullingTime="2.037087327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:56.118603278 +0000 UTC m=+68.927711858" watchObservedRunningTime="2026-09-08 06:35:56.118621892 +0000 UTC m=+68.927730518" Sep 08 06:35:57.064729 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:57.064467 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:57.064729 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:57.064552 2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:35:57.065246 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:57.065013 2547 scope.go:117] "RemoveContainer" containerID="27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840" Sep 08 06:35:57.065246 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:57.065194 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-vgqkd_openshift-console-operator(bfde7c97-51ad-4149-a800-12d32ea22d84)\"" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" podUID="bfde7c97-51ad-4149-a800-12d32ea22d84" Sep 08 06:35:59.461400 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:59.461360 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:59.461870 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:35:59.461414 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:35:59.461870 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:59.461508 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:59.461870 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:59.461546 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:59.461870 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:59.461598 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:36:07.461573611 +0000 UTC m=+80.270682172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : configmap "kube-rbac-proxy" not found Sep 08 06:35:59.461870 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:35:59.461620 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:36:07.461609336 +0000 UTC m=+80.270717895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:36:01.121098 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:01.121058 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fx7b4" event={"ID":"a23c0b0c-4502-432b-90e9-47b49c6fd9b2","Type":"ContainerStarted","Data":"6c848bf4d713f5dfbc446f4399d6bb287668d96a83d2d6f104da01e1cca51a51"} Sep 08 06:36:01.122779 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:01.122750 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4pjv" event={"ID":"3a1076f8-b2a3-46f0-b49a-3854a83cd29a","Type":"ContainerStarted","Data":"12660fd984d80d849142687bc4f8e9d75b44b6f0482031b26ceac881dccc1e94"} Sep 08 06:36:01.122923 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:01.122879 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:36:01.186946 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:01.186882 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fx7b4" podStartSLOduration=68.301798947 podStartE2EDuration="1m14.186868234s" totalImagesPullingTime="5.885069287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:01.149669709 +0000 UTC m=+73.958778288" watchObservedRunningTime="2026-09-08 06:36:01.186868234 +0000 UTC m=+73.995976829" Sep 08 06:36:02.790607 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:02.790567 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:02.790607 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:02.790613 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:02.791152 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:36:02.790773 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle podName:116cf422-4f03-420b-8080-27e0313c0a2f nodeName:}" failed. No retries permitted until 2026-09-08 06:36:18.790753827 +0000 UTC m=+91.599862407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle") pod "router-default-7ccd684956-xcbxb" (UID: "116cf422-4f03-420b-8080-27e0313c0a2f") : configmap references non-existent config key: service-ca.crt Sep 08 06:36:02.793029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:02.793002 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/116cf422-4f03-420b-8080-27e0313c0a2f-metrics-certs\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:07.530036 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:07.529998 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:07.530404 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:07.530043 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:07.530404 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:36:07.530133 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:36:07.530404 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:36:07.530185 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls podName:6bd49282-0656-4f25-9f76-0405f523131c nodeName:}" failed. No retries permitted until 2026-09-08 06:36:23.530171609 +0000 UTC m=+96.339280166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77plq" (UID: "6bd49282-0656-4f25-9f76-0405f523131c") : secret "insights-runtime-extractor-tls" not found Sep 08 06:36:07.530543 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:07.530462 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bd49282-0656-4f25-9f76-0405f523131c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:09.682129 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:09.682093 2547 scope.go:117] "RemoveContainer" containerID="27f16799abde64538fedd31d67932b055e0d39e1819ccbc686e223478a42c840" Sep 08 06:36:10.151962 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.151823 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:36:10.151962 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.151917 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" event={"ID":"bfde7c97-51ad-4149-a800-12d32ea22d84","Type":"ContainerStarted","Data":"ed3541af22e98029c5ff3c8a2fc352acf5c03b631b09ebd6bf709afe4bebca9f"} Sep 08 06:36:10.152172 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.152145 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:36:10.172119 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.172060 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" podStartSLOduration=21.808442678 podStartE2EDuration="24.172044315s" totalImagesPullingTime="2.363601637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:10.171572106 +0000 UTC m=+82.980680888" watchObservedRunningTime="2026-09-08 06:36:10.172044315 +0000 UTC m=+82.981152894" Sep 08 06:36:10.172327 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.172294 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r4pjv" podStartSLOduration=76.915012445 podStartE2EDuration="1m23.172284187s" totalImagesPullingTime="6.257271742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:01.187292982 +0000 UTC m=+73.996401562" watchObservedRunningTime="2026-09-08 06:36:10.172284187 +0000 UTC m=+82.981392762" Sep 08 06:36:10.692200 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:10.692168 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-vgqkd" Sep 08 06:36:16.039581 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.039543 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-h6z48"] Sep 08 06:36:16.042764 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.042746 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:16.057143 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.057120 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mss42\"" Sep 08 06:36:16.057249 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.057169 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 06:36:16.057249 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.057120 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 06:36:16.080201 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.080167 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-h6z48"] Sep 08 06:36:16.114907 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.114873 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bdff6d449-z6k6z"] Sep 08 06:36:16.117807 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.117786 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.121985 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.121964 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-khbh2\"" Sep 08 06:36:16.122069 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.122017 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 06:36:16.122193 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.122180 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 06:36:16.122395 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.122378 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 06:36:16.133430 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.133406 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 06:36:16.145673 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.145647 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdff6d449-z6k6z"] Sep 08 06:36:16.197759 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197732 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-installation-pull-secrets\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.197759 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197760 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-image-registry-private-configuration\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.197929 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197784 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-certificates\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.197929 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197816 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj9tb\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-kube-api-access-qj9tb\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.197929 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197846 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-tls\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.197929 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197877 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/262c0e6c-c940-497c-b5b4-803a0c37afac-ca-trust-extracted\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.198112 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197956 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rz9g\" (UniqueName: \"kubernetes.io/projected/f145e1de-ffc8-46de-ae56-02cb59bf59cb-kube-api-access-6rz9g\") pod \"downloads-85d98c998f-h6z48\" (UID: \"f145e1de-ffc8-46de-ae56-02cb59bf59cb\") " pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:16.198112 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.197983 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-bound-sa-token\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.198112 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.198006 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-trusted-ca\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.298987 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.298899 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-installation-pull-secrets\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.298987 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.298934 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-image-registry-private-configuration\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.298987 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.298955 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-certificates\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.298987 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.298971 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9tb\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-kube-api-access-qj9tb\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299006 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-tls\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299037 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/262c0e6c-c940-497c-b5b4-803a0c37afac-ca-trust-extracted\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299064 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rz9g\" (UniqueName: \"kubernetes.io/projected/f145e1de-ffc8-46de-ae56-02cb59bf59cb-kube-api-access-6rz9g\") pod \"downloads-85d98c998f-h6z48\" (UID: \"f145e1de-ffc8-46de-ae56-02cb59bf59cb\") " pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:16.299302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299217 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-bound-sa-token\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299259 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-trusted-ca\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299574 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299547 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/262c0e6c-c940-497c-b5b4-803a0c37afac-ca-trust-extracted\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.299951 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.299922 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-certificates\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.300268 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.300249 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/262c0e6c-c940-497c-b5b4-803a0c37afac-trusted-ca\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.301614 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.301590 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-installation-pull-secrets\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.301820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.301798 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/262c0e6c-c940-497c-b5b4-803a0c37afac-image-registry-private-configuration\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.301873 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.301800 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-registry-tls\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.311831 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.311808 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-bound-sa-token\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.311932 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.311911 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj9tb\" (UniqueName: \"kubernetes.io/projected/262c0e6c-c940-497c-b5b4-803a0c37afac-kube-api-access-qj9tb\") pod \"image-registry-6bdff6d449-z6k6z\" (UID: \"262c0e6c-c940-497c-b5b4-803a0c37afac\") " pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.312416 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.312400 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rz9g\" (UniqueName: \"kubernetes.io/projected/f145e1de-ffc8-46de-ae56-02cb59bf59cb-kube-api-access-6rz9g\") pod \"downloads-85d98c998f-h6z48\" (UID: \"f145e1de-ffc8-46de-ae56-02cb59bf59cb\") " pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:16.351610 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.351584 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:16.427062 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.427034 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:16.647416 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.647395 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-h6z48"] Sep 08 06:36:16.649271 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:16.649245 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf145e1de_ffc8_46de_ae56_02cb59bf59cb.slice/crio-8e1dd07e98f93053ba3c8e3782d91702615632893d55a0a12eff6215c5b6960a WatchSource:0}: Error finding container 8e1dd07e98f93053ba3c8e3782d91702615632893d55a0a12eff6215c5b6960a: Status 404 returned error can't find the container with id 8e1dd07e98f93053ba3c8e3782d91702615632893d55a0a12eff6215c5b6960a Sep 08 06:36:16.716033 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:16.716007 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdff6d449-z6k6z"] Sep 08 06:36:16.719180 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:16.719156 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262c0e6c_c940_497c_b5b4_803a0c37afac.slice/crio-ff153be476686111a6d64b87122929a6e3021224ca846ea5c614c52e51623ff9 WatchSource:0}: Error finding container ff153be476686111a6d64b87122929a6e3021224ca846ea5c614c52e51623ff9: Status 404 returned error can't find the container with id ff153be476686111a6d64b87122929a6e3021224ca846ea5c614c52e51623ff9 Sep 08 06:36:17.174037 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:17.174000 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-h6z48" event={"ID":"f145e1de-ffc8-46de-ae56-02cb59bf59cb","Type":"ContainerStarted","Data":"8e1dd07e98f93053ba3c8e3782d91702615632893d55a0a12eff6215c5b6960a"} Sep 08 06:36:17.175562 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:17.175529 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" event={"ID":"262c0e6c-c940-497c-b5b4-803a0c37afac","Type":"ContainerStarted","Data":"38ed5d06b9f0f68365add3485bf2ee4cbf37c938f7222e2a22e91dfcd116a56d"} Sep 08 06:36:17.175665 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:17.175572 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" event={"ID":"262c0e6c-c940-497c-b5b4-803a0c37afac","Type":"ContainerStarted","Data":"ff153be476686111a6d64b87122929a6e3021224ca846ea5c614c52e51623ff9"} Sep 08 06:36:17.175731 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:17.175662 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:18.820826 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:18.820787 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:18.821811 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:18.821774 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/116cf422-4f03-420b-8080-27e0313c0a2f-service-ca-bundle\") pod \"router-default-7ccd684956-xcbxb\" (UID: \"116cf422-4f03-420b-8080-27e0313c0a2f\") " pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:18.970704 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:18.970669 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cgvq6\"" Sep 08 06:36:18.978989 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:18.978957 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:19.269600 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:19.269486 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" podStartSLOduration=3.269462887 podStartE2EDuration="3.269462887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:17.204930393 +0000 UTC m=+90.014038973" watchObservedRunningTime="2026-09-08 06:36:19.269462887 +0000 UTC m=+92.078571467" Sep 08 06:36:19.270603 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:19.270449 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ccd684956-xcbxb"] Sep 08 06:36:19.273632 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:19.273602 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116cf422_4f03_420b_8080_27e0313c0a2f.slice/crio-e1a93ec17ac4e3869fd7430244794521654582d3b45e86a180ea6123d7476be2 WatchSource:0}: Error finding container e1a93ec17ac4e3869fd7430244794521654582d3b45e86a180ea6123d7476be2: Status 404 returned error can't find the container with id e1a93ec17ac4e3869fd7430244794521654582d3b45e86a180ea6123d7476be2 Sep 08 06:36:20.190388 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:20.190344 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ccd684956-xcbxb" event={"ID":"116cf422-4f03-420b-8080-27e0313c0a2f","Type":"ContainerStarted","Data":"1b01a2408b9f372a1d09a408df8950efec270e182eeefef5000e7ab9868193e1"} Sep 08 06:36:20.190869 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:20.190402 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ccd684956-xcbxb" event={"ID":"116cf422-4f03-420b-8080-27e0313c0a2f","Type":"ContainerStarted","Data":"e1a93ec17ac4e3869fd7430244794521654582d3b45e86a180ea6123d7476be2"} Sep 08 06:36:20.214395 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:20.214341 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7ccd684956-xcbxb" podStartSLOduration=34.214325676 podStartE2EDuration="34.214325676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:20.213139833 +0000 UTC m=+93.022248423" watchObservedRunningTime="2026-09-08 06:36:20.214325676 +0000 UTC m=+93.023434255" Sep 08 06:36:20.979493 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:20.979455 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:20.982354 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:20.982329 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:21.194250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:21.194214 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:21.195541 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:21.195511 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7ccd684956-xcbxb" Sep 08 06:36:23.566028 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:23.565990 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:23.568753 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:23.568727 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bd49282-0656-4f25-9f76-0405f523131c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77plq\" (UID: \"6bd49282-0656-4f25-9f76-0405f523131c\") " pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:23.737554 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:23.737516 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77plq" Sep 08 06:36:24.036729 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:24.036681 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77plq"] Sep 08 06:36:24.040263 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:24.040237 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd49282_0656_4f25_9f76_0405f523131c.slice/crio-1cdcdb5cc8244cf43e4542fe1719a3a4d486c77fdd1036bae24fbb2b87df5420 WatchSource:0}: Error finding container 1cdcdb5cc8244cf43e4542fe1719a3a4d486c77fdd1036bae24fbb2b87df5420: Status 404 returned error can't find the container with id 1cdcdb5cc8244cf43e4542fe1719a3a4d486c77fdd1036bae24fbb2b87df5420 Sep 08 06:36:24.208622 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:24.208584 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77plq" event={"ID":"6bd49282-0656-4f25-9f76-0405f523131c","Type":"ContainerStarted","Data":"69c5373a789785f0b71059d2a9294dbcd87359c6ac320c3b559cc56d115a801c"} Sep 08 06:36:24.209097 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:24.209062 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77plq" event={"ID":"6bd49282-0656-4f25-9f76-0405f523131c","Type":"ContainerStarted","Data":"1cdcdb5cc8244cf43e4542fe1719a3a4d486c77fdd1036bae24fbb2b87df5420"} Sep 08 06:36:25.214927 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.214838 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77plq" event={"ID":"6bd49282-0656-4f25-9f76-0405f523131c","Type":"ContainerStarted","Data":"44f170c5811b5ddf77b7f9a4fa6de13c128503d6b874f2a204f9ebc6bfbc6a35"} Sep 08 06:36:25.583929 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.583888 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:36:25.587147 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.587087 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d088f935-aa9c-4f71-a655-a17741bc90aa-metrics-tls\") pod \"dns-default-ht62t\" (UID: \"d088f935-aa9c-4f71-a655-a17741bc90aa\") " pod="openshift-dns/dns-default-ht62t" Sep 08 06:36:25.628522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.628481 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:36:25.634352 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.634326 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.640249 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.640223 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 06:36:25.640765 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.640740 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 06:36:25.640895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.640808 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 06:36:25.641856 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.641500 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 06:36:25.641856 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.641648 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vsqjp\"" Sep 08 06:36:25.641856 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.641700 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 06:36:25.651049 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.651021 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:36:25.785570 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785529 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.785785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785578 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjp9q\" (UniqueName: \"kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.785785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785634 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.785785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785691 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.785785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785737 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.785785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.785763 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.859685 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.859611 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jz89\"" Sep 08 06:36:25.867666 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.867643 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ht62t" Sep 08 06:36:25.886687 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886658 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.886845 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886719 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp9q\" (UniqueName: \"kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.886845 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886769 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.886845 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886843 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.887019 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886867 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.887019 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.886898 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.887592 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.887518 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.887736 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.887601 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.887838 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.887812 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.890048 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.890024 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.890156 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.890118 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.898393 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.898369 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjp9q\" (UniqueName: \"kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q\") pod \"console-7cb7fdbdd-6vkxd\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:25.946344 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:25.946312 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:31.393928 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.393888 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b"] Sep 08 06:36:31.427601 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.427560 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b"] Sep 08 06:36:31.427793 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.427689 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.432585 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.432420 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 08 06:36:31.432585 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.432437 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 06:36:31.432585 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.432463 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 08 06:36:31.432585 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.432529 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 06:36:31.432950 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.432853 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-trdw2\"" Sep 08 06:36:31.433276 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.433093 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 06:36:31.438865 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.438556 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5m4r"] Sep 08 06:36:31.462408 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.462381 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.465012 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.464798 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 06:36:31.465012 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.464798 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 06:36:31.465186 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.465053 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6jbsv\"" Sep 08 06:36:31.465521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.465345 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 06:36:31.535921 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.535883 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fa3f65-cada-4664-b6c2-4bead1a5472b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.536085 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.535940 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.536085 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.536064 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6qt\" (UniqueName: \"kubernetes.io/projected/36fa3f65-cada-4664-b6c2-4bead1a5472b-kube-api-access-hj6qt\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.536200 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.536098 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.637053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637019 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-textfile\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637064 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-tls\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637092 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-wtmp\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637123 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnp7l\" (UniqueName: \"kubernetes.io/projected/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-kube-api-access-tnp7l\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637202 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6qt\" (UniqueName: \"kubernetes.io/projected/36fa3f65-cada-4664-b6c2-4bead1a5472b-kube-api-access-hj6qt\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.637250 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637244 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637271 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637297 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637343 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-metrics-client-ca\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637385 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fa3f65-cada-4664-b6c2-4bead1a5472b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637420 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-sys\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637446 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.637504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.637468 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-root\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.638401 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.638365 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fa3f65-cada-4664-b6c2-4bead1a5472b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.640534 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.640511 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.640687 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.640662 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fa3f65-cada-4664-b6c2-4bead1a5472b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.653364 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.653307 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6qt\" (UniqueName: \"kubernetes.io/projected/36fa3f65-cada-4664-b6c2-4bead1a5472b-kube-api-access-hj6qt\") pod \"openshift-state-metrics-657fd6c54-7tx4b\" (UID: \"36fa3f65-cada-4664-b6c2-4bead1a5472b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.738279 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738239 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-sys\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738279 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738284 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-root\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738328 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-textfile\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738358 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-sys\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738359 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-tls\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738438 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-root\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738530 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738520 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-wtmp\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738561 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnp7l\" (UniqueName: \"kubernetes.io/projected/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-kube-api-access-tnp7l\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738640 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738666 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738729 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-metrics-client-ca\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.738804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738773 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-wtmp\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.739037 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.738885 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-textfile\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.739358 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.739336 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-metrics-client-ca\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.739777 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.739754 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.740457 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.740257 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" Sep 08 06:36:31.741278 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.741237 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-tls\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.741520 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.741499 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.750700 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.750654 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnp7l\" (UniqueName: \"kubernetes.io/projected/0db4edc9-94b7-4ccc-a97d-17912cfa8e8e-kube-api-access-tnp7l\") pod \"node-exporter-x5m4r\" (UID: \"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e\") " pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:31.772342 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:31.772303 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5m4r" Sep 08 06:36:32.128870 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.128839 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r4pjv" Sep 08 06:36:32.482181 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.482089 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:36:32.501041 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.501014 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.507817 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.507790 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 06:36:32.507977 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.507826 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 06:36:32.507977 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.507790 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 06:36:32.508909 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.508503 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 06:36:32.508909 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.508578 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 06:36:32.508909 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.508752 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 06:36:32.509106 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.508995 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 06:36:32.509518 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.509325 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 06:36:32.509518 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.509365 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v6wth\"" Sep 08 06:36:32.510724 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.510663 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:36:32.513640 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.513600 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 06:36:32.647493 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647464 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647653 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647509 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647653 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647541 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647653 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647572 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647653 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647648 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647666 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647684 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647730 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647801 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647841 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.647882 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647871 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.648103 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647939 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.648103 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.647962 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zfpg\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.748750 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.748654 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.748750 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.748692 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zfpg\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.748973 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.748784 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.748973 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.748834 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.748973 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.748955 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749118 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749009 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749118 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749037 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749118 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749061 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749118 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749082 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749118 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749166 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749193 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.749369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749222 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.750065 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.749954 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.750504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.750273 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.750634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.750611 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.753444 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.753416 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.753559 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.753534 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.753676 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.753968 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.754132 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.754352 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.754580 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.754603 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.757686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.754811 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.761102 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.761080 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zfpg\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg\") pod \"alertmanager-main-0\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:32.814950 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:32.814913 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:36:33.488786 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:33.488567 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db4edc9_94b7_4ccc_a97d_17912cfa8e8e.slice/crio-5b988a89471304fdb26d7f82bc078fae6105756ebadbc197b9b2351213bdbe11 WatchSource:0}: Error finding container 5b988a89471304fdb26d7f82bc078fae6105756ebadbc197b9b2351213bdbe11: Status 404 returned error can't find the container with id 5b988a89471304fdb26d7f82bc078fae6105756ebadbc197b9b2351213bdbe11 Sep 08 06:36:33.609804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.609776 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:36:33.633185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.633032 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:36:33.633185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.633124 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.641532 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.641506 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 06:36:33.757142 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757066 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757305 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757140 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4dl\" (UniqueName: \"kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757305 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757246 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757305 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757276 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757442 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757308 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757442 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757345 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.757442 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.757377 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.771904 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.771874 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ht62t"] Sep 08 06:36:33.774958 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:33.774933 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd088f935_aa9c_4f71_a655_a17741bc90aa.slice/crio-e01e4ff185a92e26d2f0fb4b91561402e5bae3c1ba5994b65d1dab0711e1c785 WatchSource:0}: Error finding container e01e4ff185a92e26d2f0fb4b91561402e5bae3c1ba5994b65d1dab0711e1c785: Status 404 returned error can't find the container with id e01e4ff185a92e26d2f0fb4b91561402e5bae3c1ba5994b65d1dab0711e1c785 Sep 08 06:36:33.775989 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.775964 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:36:33.777796 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:33.777774 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb17b2d_c32c_42d6_8c56_dc634017872b.slice/crio-3faf55455bbac213aca0e4823eb4425f8d1ce9900e5eaed4810010688b0a0e91 WatchSource:0}: Error finding container 3faf55455bbac213aca0e4823eb4425f8d1ce9900e5eaed4810010688b0a0e91: Status 404 returned error can't find the container with id 3faf55455bbac213aca0e4823eb4425f8d1ce9900e5eaed4810010688b0a0e91 Sep 08 06:36:33.787618 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.787594 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:36:33.790761 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.790685 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b"] Sep 08 06:36:33.791173 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:33.791124 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231542dc_9688_4604_9cbe_4ab3e1522430.slice/crio-db0fe49fab6ef615bf22d5fed79ecffea1fec84d45d7551e0af91207de903a9d WatchSource:0}: Error finding container db0fe49fab6ef615bf22d5fed79ecffea1fec84d45d7551e0af91207de903a9d: Status 404 returned error can't find the container with id db0fe49fab6ef615bf22d5fed79ecffea1fec84d45d7551e0af91207de903a9d Sep 08 06:36:33.792985 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:33.792961 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fa3f65_cada_4664_b6c2_4bead1a5472b.slice/crio-dc7157aa9881f0c254aa619b6d1ddc278f9ced1b3c1d4618d2e8ea44d24448b6 WatchSource:0}: Error finding container dc7157aa9881f0c254aa619b6d1ddc278f9ced1b3c1d4618d2e8ea44d24448b6: Status 404 returned error can't find the container with id dc7157aa9881f0c254aa619b6d1ddc278f9ced1b3c1d4618d2e8ea44d24448b6 Sep 08 06:36:33.858027 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.857997 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858159 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858036 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858159 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858057 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858159 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858111 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858268 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858174 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4dl\" (UniqueName: \"kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858268 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858233 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858268 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858255 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858979 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858919 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.858979 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.858924 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.859216 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.859194 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.859485 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.859462 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.860644 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.860616 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.860765 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.860703 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.866733 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.866699 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4dl\" (UniqueName: \"kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl\") pod \"console-5756dbd4c5-cxm6z\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:33.953837 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:33.953804 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:34.260458 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.259005 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77plq" event={"ID":"6bd49282-0656-4f25-9f76-0405f523131c","Type":"ContainerStarted","Data":"83d4f639f70b39308198e6749c9329133b92ba58f7a26d3aebe16f1645af0541"} Sep 08 06:36:34.262303 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.262271 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ht62t" event={"ID":"d088f935-aa9c-4f71-a655-a17741bc90aa","Type":"ContainerStarted","Data":"e01e4ff185a92e26d2f0fb4b91561402e5bae3c1ba5994b65d1dab0711e1c785"} Sep 08 06:36:34.268629 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.268598 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" event={"ID":"36fa3f65-cada-4664-b6c2-4bead1a5472b","Type":"ContainerStarted","Data":"789c7302e2cf068f9c4a31eb1cf80ae70aadfb196f2b868242a83ea8131292be"} Sep 08 06:36:34.268787 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.268656 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" event={"ID":"36fa3f65-cada-4664-b6c2-4bead1a5472b","Type":"ContainerStarted","Data":"0986127f35f2471d79737d4d4c0d204458a6cd481a7e6a998fffb61f6663f86a"} Sep 08 06:36:34.268787 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.268685 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" event={"ID":"36fa3f65-cada-4664-b6c2-4bead1a5472b","Type":"ContainerStarted","Data":"dc7157aa9881f0c254aa619b6d1ddc278f9ced1b3c1d4618d2e8ea44d24448b6"} Sep 08 06:36:34.270959 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.270838 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-h6z48" event={"ID":"f145e1de-ffc8-46de-ae56-02cb59bf59cb","Type":"ContainerStarted","Data":"e0ade5318f541c820b5d2915d2c195c37fcbf1feef511e012c3c60d3acd427b1"} Sep 08 06:36:34.271701 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.271639 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:34.273694 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.273627 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5m4r" event={"ID":"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e","Type":"ContainerStarted","Data":"5b988a89471304fdb26d7f82bc078fae6105756ebadbc197b9b2351213bdbe11"} Sep 08 06:36:34.275852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.275813 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb7fdbdd-6vkxd" event={"ID":"231542dc-9688-4604-9cbe-4ab3e1522430","Type":"ContainerStarted","Data":"db0fe49fab6ef615bf22d5fed79ecffea1fec84d45d7551e0af91207de903a9d"} Sep 08 06:36:34.282950 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.282870 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"3faf55455bbac213aca0e4823eb4425f8d1ce9900e5eaed4810010688b0a0e91"} Sep 08 06:36:34.283078 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.283059 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:36:34.283270 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.283249 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-h6z48" Sep 08 06:36:34.288532 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.288430 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-77plq" podStartSLOduration=33.989887384 podStartE2EDuration="43.288411566s" totalImagesPullingTime="9.298524182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:35:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:34.286877905 +0000 UTC m=+107.095986497" watchObservedRunningTime="2026-09-08 06:36:34.288411566 +0000 UTC m=+107.097520139" Sep 08 06:36:34.292799 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:34.292770 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22970474_c19d_4764_9ad2_d7b71465c90f.slice/crio-f7835676d59227a053409bb2e9d0db84fb7d65833b2abdd79a6ed3feec0e3395 WatchSource:0}: Error finding container f7835676d59227a053409bb2e9d0db84fb7d65833b2abdd79a6ed3feec0e3395: Status 404 returned error can't find the container with id f7835676d59227a053409bb2e9d0db84fb7d65833b2abdd79a6ed3feec0e3395 Sep 08 06:36:34.314237 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:34.314180 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-h6z48" podStartSLOduration=1.478045467 podStartE2EDuration="18.314158833s" totalImagesPullingTime="16.836113366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:34.312972784 +0000 UTC m=+107.122081366" watchObservedRunningTime="2026-09-08 06:36:34.314158833 +0000 UTC m=+107.123267414" Sep 08 06:36:35.295590 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.295123 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5756dbd4c5-cxm6z" event={"ID":"22970474-c19d-4764-9ad2-d7b71465c90f","Type":"ContainerStarted","Data":"f7835676d59227a053409bb2e9d0db84fb7d65833b2abdd79a6ed3feec0e3395"} Sep 08 06:36:35.665132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.664073 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7666cc5668-cd5q7"] Sep 08 06:36:35.687697 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.685363 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7666cc5668-cd5q7"] Sep 08 06:36:35.689006 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.688012 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.691750 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.691703 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qhj9j\"" Sep 08 06:36:35.692477 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.692448 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 06:36:35.692642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.692478 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 06:36:35.693148 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.693102 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9m7sfa1rvm544\"" Sep 08 06:36:35.693403 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.693384 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 06:36:35.693620 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.693602 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877609 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-metrics-server-audit-profiles\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877679 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-client-certs\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877725 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-tls\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877755 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-client-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877813 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1a6120e-7c8e-442f-9db6-0d90b69185c9-audit-log\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877841 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm5cv\" (UniqueName: \"kubernetes.io/projected/e1a6120e-7c8e-442f-9db6-0d90b69185c9-kube-api-access-xm5cv\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.878745 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.877900 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978465 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978383 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978474 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-metrics-server-audit-profiles\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978519 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-client-certs\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978547 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-tls\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978632 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978579 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-client-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978635 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1a6120e-7c8e-442f-9db6-0d90b69185c9-audit-log\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.978895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.978663 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm5cv\" (UniqueName: \"kubernetes.io/projected/e1a6120e-7c8e-442f-9db6-0d90b69185c9-kube-api-access-xm5cv\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.980411 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.979792 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e1a6120e-7c8e-442f-9db6-0d90b69185c9-audit-log\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.980411 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.979991 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.981640 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.981351 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e1a6120e-7c8e-442f-9db6-0d90b69185c9-metrics-server-audit-profiles\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.983244 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.982975 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-client-certs\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:35.990850 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.990809 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-client-ca-bundle\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:36.000778 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.996657 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e1a6120e-7c8e-442f-9db6-0d90b69185c9-secret-metrics-server-tls\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:36.000778 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:35.999853 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm5cv\" (UniqueName: \"kubernetes.io/projected/e1a6120e-7c8e-442f-9db6-0d90b69185c9-kube-api-access-xm5cv\") pod \"metrics-server-7666cc5668-cd5q7\" (UID: \"e1a6120e-7c8e-442f-9db6-0d90b69185c9\") " pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:36.011175 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:36.011062 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:36.434971 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:36.434590 2547 patch_prober.go:28] interesting pod/image-registry-6bdff6d449-z6k6z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 08 06:36:36.434971 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:36.434654 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" podUID="262c0e6c-c940-497c-b5b4-803a0c37afac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 06:36:38.185509 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:38.185423 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bdff6d449-z6k6z" Sep 08 06:36:39.921382 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:39.921344 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7666cc5668-cd5q7"] Sep 08 06:36:39.927418 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:39.927388 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a6120e_7c8e_442f_9db6_0d90b69185c9.slice/crio-5f4f425d9b2dadebb530b01a3f37ace1e8af42c32f89440113003ef4731edc59 WatchSource:0}: Error finding container 5f4f425d9b2dadebb530b01a3f37ace1e8af42c32f89440113003ef4731edc59: Status 404 returned error can't find the container with id 5f4f425d9b2dadebb530b01a3f37ace1e8af42c32f89440113003ef4731edc59 Sep 08 06:36:40.025164 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.025136 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:36:40.055736 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.054400 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:36:40.070784 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.070185 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:36:40.070784 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.070305 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.115847 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.115901 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z9fh\" (UniqueName: \"kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.115927 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.115952 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.116039 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.116095 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.116329 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.116111 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.216735 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.216789 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z9fh\" (UniqueName: \"kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.216821 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.216845 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.216922 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.217003 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.217028 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.218730 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.219880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.219307 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.222341 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.221206 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.222826 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.222786 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.224099 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.224028 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.225867 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.225616 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.232090 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.231903 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z9fh\" (UniqueName: \"kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh\") pod \"console-7b6884c986-8wkfc\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.326616 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.326194 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" event={"ID":"36fa3f65-cada-4664-b6c2-4bead1a5472b","Type":"ContainerStarted","Data":"b5dc18371100a12351cd1935d6515c58ecaff72dbd408468376d60f17fecf86c"} Sep 08 06:36:40.328731 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.328210 2547 generic.go:356] "Generic (PLEG): container finished" podID="0db4edc9-94b7-4ccc-a97d-17912cfa8e8e" containerID="4aa8a296db10996ca8e42598decf94689c9d812f6ee7767e4fb3b13845a0e8a3" exitCode=0 Sep 08 06:36:40.328731 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.328283 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5m4r" event={"ID":"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e","Type":"ContainerDied","Data":"4aa8a296db10996ca8e42598decf94689c9d812f6ee7767e4fb3b13845a0e8a3"} Sep 08 06:36:40.332884 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.332655 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb7fdbdd-6vkxd" event={"ID":"231542dc-9688-4604-9cbe-4ab3e1522430","Type":"ContainerStarted","Data":"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e"} Sep 08 06:36:40.336766 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.336358 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d" exitCode=0 Sep 08 06:36:40.336766 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.336426 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d"} Sep 08 06:36:40.340644 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.340617 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5756dbd4c5-cxm6z" event={"ID":"22970474-c19d-4764-9ad2-d7b71465c90f","Type":"ContainerStarted","Data":"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2"} Sep 08 06:36:40.345134 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.345114 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" event={"ID":"e1a6120e-7c8e-442f-9db6-0d90b69185c9","Type":"ContainerStarted","Data":"5f4f425d9b2dadebb530b01a3f37ace1e8af42c32f89440113003ef4731edc59"} Sep 08 06:36:40.347050 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.346998 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ht62t" event={"ID":"d088f935-aa9c-4f71-a655-a17741bc90aa","Type":"ContainerStarted","Data":"e0ecd6ef54072970d867aafd48d21bac85ceb3e6028958e1a1a61d3e539fc74e"} Sep 08 06:36:40.349851 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.349362 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7tx4b" podStartSLOduration=3.462000368 podStartE2EDuration="9.349344681s" totalImagesPullingTime="5.887344313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:40.34767542 +0000 UTC m=+113.156783999" watchObservedRunningTime="2026-09-08 06:36:40.349344681 +0000 UTC m=+113.158453263" Sep 08 06:36:40.377225 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.375922 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5756dbd4c5-cxm6z" podStartSLOduration=1.671213415 podStartE2EDuration="7.375902911s" totalImagesPullingTime="5.704689496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:40.375194983 +0000 UTC m=+113.184303564" watchObservedRunningTime="2026-09-08 06:36:40.375902911 +0000 UTC m=+113.185011490" Sep 08 06:36:40.384139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.383672 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:40.400641 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.400551 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb7fdbdd-6vkxd" podStartSLOduration=9.199573567 podStartE2EDuration="15.40052736s" totalImagesPullingTime="6.200953793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:40.399313468 +0000 UTC m=+113.208422061" watchObservedRunningTime="2026-09-08 06:36:40.40052736 +0000 UTC m=+113.209635941" Sep 08 06:36:40.691965 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:40.690758 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:36:40.696827 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:40.696755 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe4cbd8_ae94_43c7_aeed_10e15b705c69.slice/crio-3184158d1dc327496d3aee753db2041f5a40cb45f341a771e4c2a73708b8e342 WatchSource:0}: Error finding container 3184158d1dc327496d3aee753db2041f5a40cb45f341a771e4c2a73708b8e342: Status 404 returned error can't find the container with id 3184158d1dc327496d3aee753db2041f5a40cb45f341a771e4c2a73708b8e342 Sep 08 06:36:41.361720 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.361667 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6884c986-8wkfc" event={"ID":"5fe4cbd8-ae94-43c7-aeed-10e15b705c69","Type":"ContainerStarted","Data":"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba"} Sep 08 06:36:41.362255 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.361764 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6884c986-8wkfc" event={"ID":"5fe4cbd8-ae94-43c7-aeed-10e15b705c69","Type":"ContainerStarted","Data":"3184158d1dc327496d3aee753db2041f5a40cb45f341a771e4c2a73708b8e342"} Sep 08 06:36:41.365262 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.365226 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ht62t" event={"ID":"d088f935-aa9c-4f71-a655-a17741bc90aa","Type":"ContainerStarted","Data":"5452b647b0f38a880b4543cf8e6adc165eee91c80e50060f84854e5f38f8dfd0"} Sep 08 06:36:41.365396 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.365358 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ht62t" Sep 08 06:36:41.375110 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.374542 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5m4r" event={"ID":"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e","Type":"ContainerStarted","Data":"8b49fd19d2cd0e8c4b1f48e0d99fe3a8fd27ce1b4c4ce66c5d43a227d5d364ad"} Sep 08 06:36:41.375110 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.374606 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5m4r" event={"ID":"0db4edc9-94b7-4ccc-a97d-17912cfa8e8e","Type":"ContainerStarted","Data":"b3e76c8f0139234232a4fe20b457f863a7281dd27529c5d2830745d4cb8be18b"} Sep 08 06:36:41.384980 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.384904 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6884c986-8wkfc" podStartSLOduration=1.384883503 podStartE2EDuration="1.384883503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:41.382900616 +0000 UTC m=+114.192009199" watchObservedRunningTime="2026-09-08 06:36:41.384883503 +0000 UTC m=+114.193992085" Sep 08 06:36:41.416926 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.416863 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5m4r" podStartSLOduration=6.382413696 podStartE2EDuration="10.416836824s" totalImagesPullingTime="3.902902991s" totalInitContainerRuntime="131.520137ms" isStatefulPod=true podCreationTimestamp="2026-09-08 06:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:41.410011735 +0000 UTC m=+114.219120316" watchObservedRunningTime="2026-09-08 06:36:41.416836824 +0000 UTC m=+114.225945407" Sep 08 06:36:41.443266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:41.442616 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ht62t" podStartSLOduration=74.332309945 podStartE2EDuration="1m20.442592092s" totalImagesPullingTime="6.110282147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:41.441767474 +0000 UTC m=+114.250876052" watchObservedRunningTime="2026-09-08 06:36:41.442592092 +0000 UTC m=+114.251700675" Sep 08 06:36:43.382326 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.382284 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" event={"ID":"e1a6120e-7c8e-442f-9db6-0d90b69185c9","Type":"ContainerStarted","Data":"86eaaccfb295deb4f31f6861cc9eedfc3c7688cdce9cba5e59df61cf816543b5"} Sep 08 06:36:43.385774 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.385745 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5"} Sep 08 06:36:43.385957 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.385930 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f"} Sep 08 06:36:43.386116 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.385985 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68"} Sep 08 06:36:43.386116 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.386026 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366"} Sep 08 06:36:43.386116 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.386063 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad"} Sep 08 06:36:43.405398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.405358 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" podStartSLOduration=5.793604023 podStartE2EDuration="8.405343087s" totalImagesPullingTime="2.611739064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:43.404453921 +0000 UTC m=+116.213562501" watchObservedRunningTime="2026-09-08 06:36:43.405343087 +0000 UTC m=+116.214451664" Sep 08 06:36:43.954869 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.954822 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:43.955123 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.954912 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:43.959437 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:43.959411 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:44.394263 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:44.394234 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:36:45.946962 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:45.946925 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:36:46.400257 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:46.400219 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerStarted","Data":"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980"} Sep 08 06:36:46.437211 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:46.437153 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8738188080000002 podStartE2EDuration="14.437131364s" totalImagesPullingTime="11.527121584s" totalInitContainerRuntime="36.190972ms" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:46.436108972 +0000 UTC m=+119.245217552" watchObservedRunningTime="2026-09-08 06:36:46.437131364 +0000 UTC m=+119.246239944" Sep 08 06:36:50.384494 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:50.384452 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:50.385014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:50.384516 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:50.389420 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:50.389394 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:50.419139 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:50.419112 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:36:50.469088 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:50.469054 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:36:51.390517 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:51.390480 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ht62t" Sep 08 06:36:56.011297 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:56.011258 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:56.011796 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:56.011323 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:36:57.477867 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:57.477830 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:36:57.480224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:57.480193 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfb4d491-ae35-479a-85df-e41f06cc209b-metrics-certs\") pod \"network-metrics-daemon-vfqp2\" (UID: \"cfb4d491-ae35-479a-85df-e41f06cc209b\") " pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:36:57.704002 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:57.703975 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rcs59\"" Sep 08 06:36:57.712016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:57.711995 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vfqp2" Sep 08 06:36:57.983564 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:57.983536 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vfqp2"] Sep 08 06:36:57.985332 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:36:57.985303 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4d491_ae35_479a_85df_e41f06cc209b.slice/crio-78fc111fd677b55dab91a72bde2ee44229f391c0c94526b9fe6586046a18e218 WatchSource:0}: Error finding container 78fc111fd677b55dab91a72bde2ee44229f391c0c94526b9fe6586046a18e218: Status 404 returned error can't find the container with id 78fc111fd677b55dab91a72bde2ee44229f391c0c94526b9fe6586046a18e218 Sep 08 06:36:58.448790 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:58.448750 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfqp2" event={"ID":"cfb4d491-ae35-479a-85df-e41f06cc209b","Type":"ContainerStarted","Data":"78fc111fd677b55dab91a72bde2ee44229f391c0c94526b9fe6586046a18e218"} Sep 08 06:36:59.458548 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:59.458507 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfqp2" event={"ID":"cfb4d491-ae35-479a-85df-e41f06cc209b","Type":"ContainerStarted","Data":"d497c37cfcd26efbb4b3906141f8537493b3cee66ba926e102618604c07d80c9"} Sep 08 06:36:59.458956 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:59.458600 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vfqp2" event={"ID":"cfb4d491-ae35-479a-85df-e41f06cc209b","Type":"ContainerStarted","Data":"b3f9a6c3bd20d8363c79a4faf6e5c34d4c26a3c70e25e5d820763b4de068093e"} Sep 08 06:36:59.474551 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:36:59.474502 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vfqp2" podStartSLOduration=131.568611126 podStartE2EDuration="2m12.474487918s" totalImagesPullingTime="905.876792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:59.474161474 +0000 UTC m=+132.283270055" watchObservedRunningTime="2026-09-08 06:36:59.474487918 +0000 UTC m=+132.283596497" Sep 08 06:37:05.370162 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.370099 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cb7fdbdd-6vkxd" podUID="231542dc-9688-4604-9cbe-4ab3e1522430" containerName="console" containerID="cri-o://d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e" gracePeriod=15 Sep 08 06:37:05.660410 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.660383 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:37:05.751133 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751099 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751272 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751152 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjp9q\" (UniqueName: \"kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751272 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751173 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751272 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751192 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751272 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751246 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751469 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751297 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config\") pod \"231542dc-9688-4604-9cbe-4ab3e1522430\" (UID: \"231542dc-9688-4604-9cbe-4ab3e1522430\") " Sep 08 06:37:05.751644 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751610 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca" (OuterVolumeSpecName: "service-ca") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:05.751814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751654 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:05.751814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.751751 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config" (OuterVolumeSpecName: "console-config") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:05.753536 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.753514 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:05.753606 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.753506 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:05.753606 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.753587 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q" (OuterVolumeSpecName: "kube-api-access-kjp9q") pod "231542dc-9688-4604-9cbe-4ab3e1522430" (UID: "231542dc-9688-4604-9cbe-4ab3e1522430"). InnerVolumeSpecName "kube-api-access-kjp9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:37:05.852776 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852734 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:05.852776 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852769 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-console-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:05.852776 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852782 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/231542dc-9688-4604-9cbe-4ab3e1522430-console-oauth-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:05.853009 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852793 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjp9q\" (UniqueName: \"kubernetes.io/projected/231542dc-9688-4604-9cbe-4ab3e1522430-kube-api-access-kjp9q\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:05.853009 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852805 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-oauth-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:05.853009 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:05.852818 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/231542dc-9688-4604-9cbe-4ab3e1522430-service-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:06.486427 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.486390 2547 generic.go:356] "Generic (PLEG): container finished" podID="231542dc-9688-4604-9cbe-4ab3e1522430" containerID="d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e" exitCode=0 Sep 08 06:37:06.486863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.486440 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb7fdbdd-6vkxd" event={"ID":"231542dc-9688-4604-9cbe-4ab3e1522430","Type":"ContainerDied","Data":"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e"} Sep 08 06:37:06.486863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.486457 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb7fdbdd-6vkxd" Sep 08 06:37:06.486863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.486508 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb7fdbdd-6vkxd" event={"ID":"231542dc-9688-4604-9cbe-4ab3e1522430","Type":"ContainerDied","Data":"db0fe49fab6ef615bf22d5fed79ecffea1fec84d45d7551e0af91207de903a9d"} Sep 08 06:37:06.486863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.486534 2547 scope.go:117] "RemoveContainer" containerID="d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e" Sep 08 06:37:06.495377 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.495357 2547 scope.go:117] "RemoveContainer" containerID="d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e" Sep 08 06:37:06.495651 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:06.495631 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e\": container with ID starting with d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e not found: ID does not exist" containerID="d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e" Sep 08 06:37:06.495697 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.495660 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e"} err="failed to get container status \"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e\": rpc error: code = NotFound desc = could not find container \"d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e\": container with ID starting with d731e3328909993818d4aa763291d4ccbccedcd985508ed19979b6410cc6360e not found: ID does not exist" Sep 08 06:37:06.507186 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.507163 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:37:06.509731 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:06.509695 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb7fdbdd-6vkxd"] Sep 08 06:37:07.687399 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:07.687366 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231542dc-9688-4604-9cbe-4ab3e1522430" path="/var/lib/kubelet/pods/231542dc-9688-4604-9cbe-4ab3e1522430/volumes" Sep 08 06:37:15.489399 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.489325 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5756dbd4c5-cxm6z" podUID="22970474-c19d-4764-9ad2-d7b71465c90f" containerName="console" containerID="cri-o://20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2" gracePeriod=15 Sep 08 06:37:15.790867 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.790786 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:37:15.945071 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945034 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm4dl\" (UniqueName: \"kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945143 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945166 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945186 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945205 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945231 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945250 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle\") pod \"22970474-c19d-4764-9ad2-d7b71465c90f\" (UID: \"22970474-c19d-4764-9ad2-d7b71465c90f\") " Sep 08 06:37:15.945575 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945536 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config" (OuterVolumeSpecName: "console-config") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:15.945766 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945676 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca" (OuterVolumeSpecName: "service-ca") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:15.945766 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945697 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:15.945959 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.945936 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:15.947402 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.947368 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl" (OuterVolumeSpecName: "kube-api-access-zm4dl") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "kube-api-access-zm4dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:37:15.947529 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.947426 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:15.947863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:15.947728 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22970474-c19d-4764-9ad2-d7b71465c90f" (UID: "22970474-c19d-4764-9ad2-d7b71465c90f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:16.019000 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.018912 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:37:16.024224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.024191 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7666cc5668-cd5q7" Sep 08 06:37:16.046225 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046184 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-console-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046473 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046498 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22970474-c19d-4764-9ad2-d7b71465c90f-console-oauth-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046514 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-service-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046533 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-oauth-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046549 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22970474-c19d-4764-9ad2-d7b71465c90f-trusted-ca-bundle\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.046612 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.046564 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm4dl\" (UniqueName: \"kubernetes.io/projected/22970474-c19d-4764-9ad2-d7b71465c90f-kube-api-access-zm4dl\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:16.530910 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.530874 2547 generic.go:356] "Generic (PLEG): container finished" podID="22970474-c19d-4764-9ad2-d7b71465c90f" containerID="20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2" exitCode=0 Sep 08 06:37:16.531368 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.530934 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5756dbd4c5-cxm6z" Sep 08 06:37:16.531368 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.530954 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5756dbd4c5-cxm6z" event={"ID":"22970474-c19d-4764-9ad2-d7b71465c90f","Type":"ContainerDied","Data":"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2"} Sep 08 06:37:16.531368 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.531011 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5756dbd4c5-cxm6z" event={"ID":"22970474-c19d-4764-9ad2-d7b71465c90f","Type":"ContainerDied","Data":"f7835676d59227a053409bb2e9d0db84fb7d65833b2abdd79a6ed3feec0e3395"} Sep 08 06:37:16.531368 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.531032 2547 scope.go:117] "RemoveContainer" containerID="20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2" Sep 08 06:37:16.540768 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.540747 2547 scope.go:117] "RemoveContainer" containerID="20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2" Sep 08 06:37:16.541098 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:16.541072 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2\": container with ID starting with 20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2 not found: ID does not exist" containerID="20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2" Sep 08 06:37:16.541198 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.541103 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2"} err="failed to get container status \"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2\": rpc error: code = NotFound desc = could not find container \"20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2\": container with ID starting with 20d4ce2e07174262bbba5a45e51761077f60d93bf74099ddf9d12ae3d1edc9d2 not found: ID does not exist" Sep 08 06:37:16.553563 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.553528 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:37:16.554937 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:16.554915 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5756dbd4c5-cxm6z"] Sep 08 06:37:17.687054 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:17.687008 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22970474-c19d-4764-9ad2-d7b71465c90f" path="/var/lib/kubelet/pods/22970474-c19d-4764-9ad2-d7b71465c90f/volumes" Sep 08 06:37:51.642253 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.642215 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:51.668798 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668744 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="alertmanager" containerID="cri-o://88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad" gracePeriod=120 Sep 08 06:37:51.669014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668785 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-metric" containerID="cri-o://1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5" gracePeriod=120 Sep 08 06:37:51.669014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668808 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-web" containerID="cri-o://d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68" gracePeriod=120 Sep 08 06:37:51.669014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668839 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="prom-label-proxy" containerID="cri-o://e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980" gracePeriod=120 Sep 08 06:37:51.669014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668887 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy" containerID="cri-o://d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f" gracePeriod=120 Sep 08 06:37:51.669014 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:51.668831 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="config-reloader" containerID="cri-o://bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366" gracePeriod=120 Sep 08 06:37:52.676178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676146 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980" exitCode=0 Sep 08 06:37:52.676178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676172 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5" exitCode=0 Sep 08 06:37:52.676178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676179 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f" exitCode=0 Sep 08 06:37:52.676178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676185 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366" exitCode=0 Sep 08 06:37:52.676178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676190 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad" exitCode=0 Sep 08 06:37:52.676769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676216 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980"} Sep 08 06:37:52.676769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676301 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5"} Sep 08 06:37:52.676769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676348 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f"} Sep 08 06:37:52.676769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676386 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366"} Sep 08 06:37:52.676769 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.676426 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad"} Sep 08 06:37:52.914853 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:52.914827 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.051717 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051676 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.051885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051741 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.051885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051779 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.051885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051803 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.051885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051829 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zfpg\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.051885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051862 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051893 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051922 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.051947 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052005 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052034 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052064 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052141 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052065 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:37:53.052464 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052110 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web\") pod \"8fb17b2d-c32c-42d6-8c56-dc634017872b\" (UID: \"8fb17b2d-c32c-42d6-8c56-dc634017872b\") " Sep 08 06:37:53.052464 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052240 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:53.052464 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052425 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-main-db\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.052464 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.052446 2547 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-metrics-client-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.054599 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.054565 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:37:53.054725 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.054648 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg" (OuterVolumeSpecName: "kube-api-access-9zfpg") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "kube-api-access-9zfpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:37:53.054979 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.054951 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.055326 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.055296 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume" (OuterVolumeSpecName: "config-volume") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.055416 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.055326 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:37:53.055475 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.055444 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.055753 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.055725 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out" (OuterVolumeSpecName: "config-out") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:37:53.055753 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.055737 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.056794 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.056776 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.059746 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.059696 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.065397 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.065369 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config" (OuterVolumeSpecName: "web-config") pod "8fb17b2d-c32c-42d6-8c56-dc634017872b" (UID: "8fb17b2d-c32c-42d6-8c56-dc634017872b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:37:53.153190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153136 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fb17b2d-c32c-42d6-8c56-dc634017872b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153190 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153184 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-main-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153198 2547 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-cluster-tls-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153234 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153246 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153255 2547 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-tls-assets\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153266 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zfpg\" (UniqueName: \"kubernetes.io/projected/8fb17b2d-c32c-42d6-8c56-dc634017872b-kube-api-access-9zfpg\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153274 2547 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-volume\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153283 2547 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-web-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153292 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fb17b2d-c32c-42d6-8c56-dc634017872b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.153409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.153300 2547 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fb17b2d-c32c-42d6-8c56-dc634017872b-config-out\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:37:53.684010 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.683978 2547 generic.go:356] "Generic (PLEG): container finished" podID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerID="d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68" exitCode=0 Sep 08 06:37:53.684439 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.684106 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.687168 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.687138 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68"} Sep 08 06:37:53.687332 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.687205 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fb17b2d-c32c-42d6-8c56-dc634017872b","Type":"ContainerDied","Data":"3faf55455bbac213aca0e4823eb4425f8d1ce9900e5eaed4810010688b0a0e91"} Sep 08 06:37:53.687332 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.687241 2547 scope.go:117] "RemoveContainer" containerID="e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980" Sep 08 06:37:53.695108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.695089 2547 scope.go:117] "RemoveContainer" containerID="1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5" Sep 08 06:37:53.704347 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.704324 2547 scope.go:117] "RemoveContainer" containerID="d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f" Sep 08 06:37:53.711509 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.711477 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:53.712321 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.712299 2547 scope.go:117] "RemoveContainer" containerID="d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68" Sep 08 06:37:53.717476 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.717449 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:53.721768 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.721746 2547 scope.go:117] "RemoveContainer" containerID="bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366" Sep 08 06:37:53.728869 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.728852 2547 scope.go:117] "RemoveContainer" containerID="88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad" Sep 08 06:37:53.735839 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.735822 2547 scope.go:117] "RemoveContainer" containerID="3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d" Sep 08 06:37:53.743349 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.743326 2547 scope.go:117] "RemoveContainer" containerID="e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980" Sep 08 06:37:53.743667 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.743639 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980\": container with ID starting with e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980 not found: ID does not exist" containerID="e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980" Sep 08 06:37:53.743790 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.743673 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980"} err="failed to get container status \"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980\": rpc error: code = NotFound desc = could not find container \"e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980\": container with ID starting with e5a3e572521c55959347f1cde487ede50f3c91070c7a6bdf19996fcec3216980 not found: ID does not exist" Sep 08 06:37:53.743790 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.743694 2547 scope.go:117] "RemoveContainer" containerID="1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5" Sep 08 06:37:53.744113 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.744093 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5\": container with ID starting with 1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5 not found: ID does not exist" containerID="1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5" Sep 08 06:37:53.744187 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744118 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5"} err="failed to get container status \"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5\": rpc error: code = NotFound desc = could not find container \"1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5\": container with ID starting with 1a9285f4bccd644fb0091e07eedc718ce3088b4c102a12ef3f424955c69822d5 not found: ID does not exist" Sep 08 06:37:53.744187 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744134 2547 scope.go:117] "RemoveContainer" containerID="d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f" Sep 08 06:37:53.744398 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.744373 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f\": container with ID starting with d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f not found: ID does not exist" containerID="d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f" Sep 08 06:37:53.744473 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744409 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f"} err="failed to get container status \"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f\": rpc error: code = NotFound desc = could not find container \"d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f\": container with ID starting with d222cd5387e83ed285b5169c1aec0f4433cbed911fb8135100abebedb92b942f not found: ID does not exist" Sep 08 06:37:53.744473 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744434 2547 scope.go:117] "RemoveContainer" containerID="d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68" Sep 08 06:37:53.744688 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.744667 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68\": container with ID starting with d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68 not found: ID does not exist" containerID="d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68" Sep 08 06:37:53.744817 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744694 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68"} err="failed to get container status \"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68\": rpc error: code = NotFound desc = could not find container \"d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68\": container with ID starting with d151ebde2043d23cc47db7f6fb82c4d4bf6642207b62f0b86cb53fcd1f2ade68 not found: ID does not exist" Sep 08 06:37:53.744817 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744721 2547 scope.go:117] "RemoveContainer" containerID="bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366" Sep 08 06:37:53.744919 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.744885 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:53.745006 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.744984 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366\": container with ID starting with bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366 not found: ID does not exist" containerID="bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366" Sep 08 06:37:53.745061 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745011 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366"} err="failed to get container status \"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366\": rpc error: code = NotFound desc = could not find container \"bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366\": container with ID starting with bf217d85ce33a51f37c222a793e5e0f30c9530a8e67acbf6e8599458880ba366 not found: ID does not exist" Sep 08 06:37:53.745061 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745025 2547 scope.go:117] "RemoveContainer" containerID="88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad" Sep 08 06:37:53.745295 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745279 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-web" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745302 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-web" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745317 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745325 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745340 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22970474-c19d-4764-9ad2-d7b71465c90f" containerName="console" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745348 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="22970474-c19d-4764-9ad2-d7b71465c90f" containerName="console" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745357 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="prom-label-proxy" Sep 08 06:37:53.745369 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745364 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="prom-label-proxy" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745380 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="config-reloader" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745389 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="config-reloader" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745405 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231542dc-9688-4604-9cbe-4ab3e1522430" containerName="console" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.745281 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad\": container with ID starting with 88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad not found: ID does not exist" containerID="88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745427 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad"} err="failed to get container status \"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad\": rpc error: code = NotFound desc = could not find container \"88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad\": container with ID starting with 88eff6d9a15fec60231588b30f997bf4f46629f9d415490698dd89d94945dcad not found: ID does not exist" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745441 2547 scope.go:117] "RemoveContainer" containerID="3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745414 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="231542dc-9688-4604-9cbe-4ab3e1522430" containerName="console" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745491 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="init-config-reloader" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745502 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="init-config-reloader" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745514 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="alertmanager" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745522 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="alertmanager" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745530 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-metric" Sep 08 06:37:53.745634 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745539 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-metric" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745645 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="22970474-c19d-4764-9ad2-d7b71465c90f" containerName="console" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745654 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="config-reloader" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745660 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-web" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745666 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745673 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="231542dc-9688-4604-9cbe-4ab3e1522430" containerName="console" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745677 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="alertmanager" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745683 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="kube-rbac-proxy-metric" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745690 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" containerName="prom-label-proxy" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:37:53.745734 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d\": container with ID starting with 3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d not found: ID does not exist" containerID="3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d" Sep 08 06:37:53.746047 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.745767 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d"} err="failed to get container status \"3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d\": rpc error: code = NotFound desc = could not find container \"3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d\": container with ID starting with 3b65fa8e0a7eaec368fc1423ee9903c6b47e6905f146aa79ae9d3e7ed1b92e8d not found: ID does not exist" Sep 08 06:37:53.750841 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.750820 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.753240 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753182 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 08 06:37:53.753336 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753182 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 08 06:37:53.753336 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753186 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 08 06:37:53.753446 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753212 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 08 06:37:53.753497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753470 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 08 06:37:53.753553 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753513 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 08 06:37:53.753645 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753618 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v6wth\"" Sep 08 06:37:53.753730 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.753662 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 08 06:37:53.755801 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.755780 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 08 06:37:53.758880 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.758860 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 08 06:37:53.763749 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.763690 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:53.857812 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857772 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.857812 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857816 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857845 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857902 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857953 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.857984 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858029 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858019 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-web-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858045 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858068 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858111 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-volume\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858144 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-out\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858158 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.858224 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.858182 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49kz8\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-kube-api-access-49kz8\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959111 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959024 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-web-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959111 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959066 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959111 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959083 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959111 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959105 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-volume\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959147 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-out\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959169 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959191 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49kz8\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-kube-api-access-49kz8\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959245 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959273 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959299 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959326 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959357 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959398 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959391 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.959864 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.959529 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.960172 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.960139 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.960343 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.960319 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02694bdf-94ba-43e6-b491-62b5039c8d9e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.962521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.962496 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.962521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.962509 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963084 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.962914 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963084 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.962927 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-web-config\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963084 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.962917 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-volume\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963277 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.963125 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963277 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.963180 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02694bdf-94ba-43e6-b491-62b5039c8d9e-config-out\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.963371 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.963349 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.964076 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.964053 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02694bdf-94ba-43e6-b491-62b5039c8d9e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:53.968278 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:53.968256 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49kz8\" (UniqueName: \"kubernetes.io/projected/02694bdf-94ba-43e6-b491-62b5039c8d9e-kube-api-access-49kz8\") pod \"alertmanager-main-0\" (UID: \"02694bdf-94ba-43e6-b491-62b5039c8d9e\") " pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:54.068864 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:54.068805 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 08 06:37:54.359601 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:54.359575 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 08 06:37:54.360731 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:37:54.360689 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02694bdf_94ba_43e6_b491_62b5039c8d9e.slice/crio-82f9c7503489100369a27dbf0ca533cd55e01b5099b641438be6cfeccfae7b93 WatchSource:0}: Error finding container 82f9c7503489100369a27dbf0ca533cd55e01b5099b641438be6cfeccfae7b93: Status 404 returned error can't find the container with id 82f9c7503489100369a27dbf0ca533cd55e01b5099b641438be6cfeccfae7b93 Sep 08 06:37:54.689952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:54.689854 2547 generic.go:356] "Generic (PLEG): container finished" podID="02694bdf-94ba-43e6-b491-62b5039c8d9e" containerID="d2452767fda0fe4b9d584188c3c75556d2cb5ae8d3611cfeefa45f5a272cb097" exitCode=0 Sep 08 06:37:54.689952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:54.689939 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerDied","Data":"d2452767fda0fe4b9d584188c3c75556d2cb5ae8d3611cfeefa45f5a272cb097"} Sep 08 06:37:54.690468 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:54.690032 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"82f9c7503489100369a27dbf0ca533cd55e01b5099b641438be6cfeccfae7b93"} Sep 08 06:37:55.686863 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.686830 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb17b2d-c32c-42d6-8c56-dc634017872b" path="/var/lib/kubelet/pods/8fb17b2d-c32c-42d6-8c56-dc634017872b/volumes" Sep 08 06:37:55.687351 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.687336 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz"] Sep 08 06:37:55.690806 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.690788 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.693759 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.693737 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 08 06:37:55.693898 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.693779 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 08 06:37:55.693998 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.693978 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 08 06:37:55.694895 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.694879 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 08 06:37:55.695502 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.695484 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wqr79\"" Sep 08 06:37:55.698659 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.698637 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 08 06:37:55.700939 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.700905 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"4be35ef9fb5f8c28f372e15079b003de4d5f41d82f2657db52074a0a92e276a5"} Sep 08 06:37:55.701132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.700978 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"0ec8788712ebce36e2a07b929bf5770a8485382c6ee19bea4cc74b8b15479194"} Sep 08 06:37:55.701132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701025 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"f05e9a133429a55df7a967039f81f3bcc833af576ec2c3eeb623db0eeab062c7"} Sep 08 06:37:55.701132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701055 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"65b5edc272d7077c4861afa7bf17fd9ee5a9fa101c301cc8ea62f924af1e7ce0"} Sep 08 06:37:55.701132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701084 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"498ed65da46c2e005853064cce2cf08c2d5e9aac6851668a646326a5a66dba34"} Sep 08 06:37:55.701132 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701110 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02694bdf-94ba-43e6-b491-62b5039c8d9e","Type":"ContainerStarted","Data":"7de1e39ad624ab2516f8630dc9686dc78278b9cc12f8eb2d860add123e0c669a"} Sep 08 06:37:55.701576 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701557 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 08 06:37:55.701891 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.701870 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz"] Sep 08 06:37:55.774463 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774428 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-federate-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.774681 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774492 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.774757 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774728 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.774848 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774819 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-metrics-client-ca\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.774957 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774905 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqk7v\" (UniqueName: \"kubernetes.io/projected/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-kube-api-access-rqk7v\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.774957 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.774939 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.775040 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.775030 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-serving-certs-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.775090 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.775076 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.797870 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.797812 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.781434537 podStartE2EDuration="2.797796668s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.362131ms" isStatefulPod=false podCreationTimestamp="2026-09-08 06:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:37:55.79569224 +0000 UTC m=+188.604800831" watchObservedRunningTime="2026-09-08 06:37:55.797796668 +0000 UTC m=+188.606905248" Sep 08 06:37:55.875910 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.875866 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.875924 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-metrics-client-ca\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.875946 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqk7v\" (UniqueName: \"kubernetes.io/projected/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-kube-api-access-rqk7v\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.875963 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.875999 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-serving-certs-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.876065 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876373 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.876139 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-federate-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.876373 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.876173 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.877046 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.877015 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-serving-certs-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.877046 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.877015 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-metrics-client-ca\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.877235 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.877081 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.878686 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.878657 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-telemeter-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.879115 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.879092 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-federate-client-tls\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.879160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.879105 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.879160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.879092 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-secret-telemeter-client\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:55.886008 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:55.885980 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqk7v\" (UniqueName: \"kubernetes.io/projected/4273c74d-90bb-4c0c-81e9-c5d2143bb7e4-kube-api-access-rqk7v\") pod \"telemeter-client-655c7f7fb9-2ssgz\" (UID: \"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4\") " pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:56.002521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:56.002421 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" Sep 08 06:37:56.292556 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:56.292524 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz"] Sep 08 06:37:56.295063 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:37:56.295029 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4273c74d_90bb_4c0c_81e9_c5d2143bb7e4.slice/crio-ec36489f6d3dc690369d2edc80e1bfded0e69af8b9be1497ba3786b56bc69d1e WatchSource:0}: Error finding container ec36489f6d3dc690369d2edc80e1bfded0e69af8b9be1497ba3786b56bc69d1e: Status 404 returned error can't find the container with id ec36489f6d3dc690369d2edc80e1bfded0e69af8b9be1497ba3786b56bc69d1e Sep 08 06:37:56.706547 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:56.706451 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" event={"ID":"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4","Type":"ContainerStarted","Data":"ec36489f6d3dc690369d2edc80e1bfded0e69af8b9be1497ba3786b56bc69d1e"} Sep 08 06:37:58.717775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.717729 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" event={"ID":"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4","Type":"ContainerStarted","Data":"c63fdd8cae5404fa0a149f11265e38b1277bf0b54232f0dc55199c2ce1b73eae"} Sep 08 06:37:58.718156 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.717817 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" event={"ID":"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4","Type":"ContainerStarted","Data":"7410963cab9327cc41edb38d3ec95b3fc1e1b0c8211e4e93d3f43041dd17fc0b"} Sep 08 06:37:58.718156 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.717838 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" event={"ID":"4273c74d-90bb-4c0c-81e9-c5d2143bb7e4","Type":"ContainerStarted","Data":"a808e7a37a3a684f91f17c0b788137e610a24ed5d18ff5d98c53bfcf55a5eb23"} Sep 08 06:37:58.739883 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.739828 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-655c7f7fb9-2ssgz" podStartSLOduration=2.168145186 podStartE2EDuration="3.73980893s" totalImagesPullingTime="1.571663744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:37:58.738270191 +0000 UTC m=+191.547378762" watchObservedRunningTime="2026-09-08 06:37:58.73980893 +0000 UTC m=+191.548917512" Sep 08 06:37:58.831796 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.831758 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:37:58.835431 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.835389 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.847621 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.847593 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:37:58.900589 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900554 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900589 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900596 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900618 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900673 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900718 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prdc\" (UniqueName: \"kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900817 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:58.900956 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:58.900842 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002166 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002068 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002166 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002111 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002166 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002155 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002183 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002230 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.002522 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002254 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2prdc\" (UniqueName: \"kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.003017 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.002991 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.003017 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.003000 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.003180 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.003025 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.003501 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.003438 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.004830 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.004800 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.005016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.004995 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.012685 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.012660 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prdc\" (UniqueName: \"kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc\") pod \"console-5df9544b5f-lgx7v\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.145347 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.145308 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:37:59.427508 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.427409 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:37:59.430129 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:37:59.430094 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c20a93a_35fb_46f0_88a4_a6a12241e138.slice/crio-c2fa2bbf01ea0e181ee756d07a3b299a8703cdd54824fbc2fa0abce92c34890c WatchSource:0}: Error finding container c2fa2bbf01ea0e181ee756d07a3b299a8703cdd54824fbc2fa0abce92c34890c: Status 404 returned error can't find the container with id c2fa2bbf01ea0e181ee756d07a3b299a8703cdd54824fbc2fa0abce92c34890c Sep 08 06:37:59.724301 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.724206 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df9544b5f-lgx7v" event={"ID":"4c20a93a-35fb-46f0-88a4-a6a12241e138","Type":"ContainerStarted","Data":"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e"} Sep 08 06:37:59.724301 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.724260 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df9544b5f-lgx7v" event={"ID":"4c20a93a-35fb-46f0-88a4-a6a12241e138","Type":"ContainerStarted","Data":"c2fa2bbf01ea0e181ee756d07a3b299a8703cdd54824fbc2fa0abce92c34890c"} Sep 08 06:37:59.742421 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:37:59.742361 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5df9544b5f-lgx7v" podStartSLOduration=1.742344114 podStartE2EDuration="1.742344114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:37:59.740674655 +0000 UTC m=+192.549783236" watchObservedRunningTime="2026-09-08 06:37:59.742344114 +0000 UTC m=+192.551452694" Sep 08 06:38:09.145469 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:09.145418 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:38:09.146108 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:09.145494 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:38:09.150428 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:09.150402 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:38:09.775570 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:09.775540 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:38:09.837488 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:09.837446 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:38:34.859474 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:34.859404 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b6884c986-8wkfc" podUID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" containerName="console" containerID="cri-o://07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba" gracePeriod=15 Sep 08 06:38:35.100157 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.100132 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:38:35.205952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.205847 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.205952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.205896 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.205952 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.205936 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.206241 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.205968 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.206241 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.205997 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.206241 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206034 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.206241 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206083 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z9fh\" (UniqueName: \"kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh\") pod \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\" (UID: \"5fe4cbd8-ae94-43c7-aeed-10e15b705c69\") " Sep 08 06:38:35.206446 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206381 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:38:35.206512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206476 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca" (OuterVolumeSpecName: "service-ca") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:38:35.206512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206493 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config" (OuterVolumeSpecName: "console-config") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:38:35.206914 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.206883 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:38:35.208311 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.208281 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh" (OuterVolumeSpecName: "kube-api-access-2z9fh") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "kube-api-access-2z9fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:38:35.208311 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.208303 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:38:35.208446 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.208323 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5fe4cbd8-ae94-43c7-aeed-10e15b705c69" (UID: "5fe4cbd8-ae94-43c7-aeed-10e15b705c69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:38:35.307788 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307741 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-oauth-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.307788 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307779 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-oauth-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.307788 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307789 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z9fh\" (UniqueName: \"kubernetes.io/projected/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-kube-api-access-2z9fh\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.307788 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307799 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-trusted-ca-bundle\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.308068 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307808 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-service-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.308068 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307817 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.308068 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.307826 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe4cbd8-ae94-43c7-aeed-10e15b705c69-console-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:38:35.872090 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.872054 2547 generic.go:356] "Generic (PLEG): container finished" podID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" containerID="07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba" exitCode=0 Sep 08 06:38:35.872514 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.872104 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6884c986-8wkfc" Sep 08 06:38:35.872514 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.872138 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6884c986-8wkfc" event={"ID":"5fe4cbd8-ae94-43c7-aeed-10e15b705c69","Type":"ContainerDied","Data":"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba"} Sep 08 06:38:35.872514 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.872190 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6884c986-8wkfc" event={"ID":"5fe4cbd8-ae94-43c7-aeed-10e15b705c69","Type":"ContainerDied","Data":"3184158d1dc327496d3aee753db2041f5a40cb45f341a771e4c2a73708b8e342"} Sep 08 06:38:35.872514 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.872213 2547 scope.go:117] "RemoveContainer" containerID="07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba" Sep 08 06:38:35.880453 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.880430 2547 scope.go:117] "RemoveContainer" containerID="07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba" Sep 08 06:38:35.880780 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:38:35.880756 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba\": container with ID starting with 07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba not found: ID does not exist" containerID="07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba" Sep 08 06:38:35.880830 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.880791 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba"} err="failed to get container status \"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba\": rpc error: code = NotFound desc = could not find container \"07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba\": container with ID starting with 07d5716a83801762b889df4d824c5b971d5fffa06d2263dd53755d86345d99ba not found: ID does not exist" Sep 08 06:38:35.887787 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.887760 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:38:35.889965 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:35.889942 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6884c986-8wkfc"] Sep 08 06:38:37.688028 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:38:37.687982 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" path="/var/lib/kubelet/pods/5fe4cbd8-ae94-43c7-aeed-10e15b705c69/volumes" Sep 08 06:39:08.729040 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.729005 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:39:08.729529 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.729484 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" containerName="console" Sep 08 06:39:08.729529 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.729503 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" containerName="console" Sep 08 06:39:08.729617 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.729583 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe4cbd8-ae94-43c7-aeed-10e15b705c69" containerName="console" Sep 08 06:39:08.734331 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.734305 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.742919 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.742842 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:39:08.892732 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892662 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvpg\" (UniqueName: \"kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892732 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892737 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892993 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892786 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892993 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892851 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892993 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892907 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892993 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892931 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.892993 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.892961 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.993846 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993761 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.993846 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993810 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994067 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993853 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994067 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993869 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994067 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993890 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994067 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.993929 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvpg\" (UniqueName: \"kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994266 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.994079 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994575 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.994545 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994695 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.994655 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994789 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.994746 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.994789 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.994737 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.996217 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.996196 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:08.996322 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:08.996306 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:09.002559 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:09.002537 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvpg\" (UniqueName: \"kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg\") pod \"console-84b79b6786-gnzh9\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:09.046671 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:09.046638 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:09.320409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:09.320283 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:39:09.323156 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:39:09.323119 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d1e773_3ba2_4264_a46d_6ed3f36c551f.slice/crio-f8d7209c21ce17d676dcb6ec70770c4f027bd3496a4c1dd66ff6e33f65d8dab2 WatchSource:0}: Error finding container f8d7209c21ce17d676dcb6ec70770c4f027bd3496a4c1dd66ff6e33f65d8dab2: Status 404 returned error can't find the container with id f8d7209c21ce17d676dcb6ec70770c4f027bd3496a4c1dd66ff6e33f65d8dab2 Sep 08 06:39:10.005774 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:10.005737 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b79b6786-gnzh9" event={"ID":"d3d1e773-3ba2-4264-a46d-6ed3f36c551f","Type":"ContainerStarted","Data":"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d"} Sep 08 06:39:10.006185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:10.005787 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b79b6786-gnzh9" event={"ID":"d3d1e773-3ba2-4264-a46d-6ed3f36c551f","Type":"ContainerStarted","Data":"f8d7209c21ce17d676dcb6ec70770c4f027bd3496a4c1dd66ff6e33f65d8dab2"} Sep 08 06:39:10.028909 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:10.028852 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84b79b6786-gnzh9" podStartSLOduration=2.028834611 podStartE2EDuration="2.028834611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:39:10.027966361 +0000 UTC m=+262.837074943" watchObservedRunningTime="2026-09-08 06:39:10.028834611 +0000 UTC m=+262.837943191" Sep 08 06:39:19.047186 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:19.047147 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:19.047574 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:19.047204 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:19.051998 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:19.051971 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:20.049628 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:20.049594 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:39:20.099184 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:20.099147 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:39:45.122078 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.122001 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5df9544b5f-lgx7v" podUID="4c20a93a-35fb-46f0-88a4-a6a12241e138" containerName="console" containerID="cri-o://2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e" gracePeriod=15 Sep 08 06:39:45.366809 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.366781 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:39:45.499568 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499471 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499568 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499515 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499568 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499544 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499879 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499575 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499879 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499608 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2prdc\" (UniqueName: \"kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499879 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499631 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.499879 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.499783 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert\") pod \"4c20a93a-35fb-46f0-88a4-a6a12241e138\" (UID: \"4c20a93a-35fb-46f0-88a4-a6a12241e138\") " Sep 08 06:39:45.500101 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.500073 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:39:45.500160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.500105 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:39:45.500160 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.500108 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:39:45.500244 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.500187 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config" (OuterVolumeSpecName: "console-config") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:39:45.501949 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.501924 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:39:45.502309 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.502293 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:39:45.502355 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.502307 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc" (OuterVolumeSpecName: "kube-api-access-2prdc") pod "4c20a93a-35fb-46f0-88a4-a6a12241e138" (UID: "4c20a93a-35fb-46f0-88a4-a6a12241e138"). InnerVolumeSpecName "kube-api-access-2prdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:39:45.601034 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.600984 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601034 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601025 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-oauth-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601034 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601038 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-oauth-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601287 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601050 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-service-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601287 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601062 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2prdc\" (UniqueName: \"kubernetes.io/projected/4c20a93a-35fb-46f0-88a4-a6a12241e138-kube-api-access-2prdc\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601287 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601076 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c20a93a-35fb-46f0-88a4-a6a12241e138-trusted-ca-bundle\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:45.601287 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:45.601087 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c20a93a-35fb-46f0-88a4-a6a12241e138-console-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:39:46.159138 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.159092 2547 generic.go:356] "Generic (PLEG): container finished" podID="4c20a93a-35fb-46f0-88a4-a6a12241e138" containerID="2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e" exitCode=0 Sep 08 06:39:46.159596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.159148 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5df9544b5f-lgx7v" Sep 08 06:39:46.159596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.159177 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df9544b5f-lgx7v" event={"ID":"4c20a93a-35fb-46f0-88a4-a6a12241e138","Type":"ContainerDied","Data":"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e"} Sep 08 06:39:46.159596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.159231 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5df9544b5f-lgx7v" event={"ID":"4c20a93a-35fb-46f0-88a4-a6a12241e138","Type":"ContainerDied","Data":"c2fa2bbf01ea0e181ee756d07a3b299a8703cdd54824fbc2fa0abce92c34890c"} Sep 08 06:39:46.159596 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.159251 2547 scope.go:117] "RemoveContainer" containerID="2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e" Sep 08 06:39:46.167571 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.167550 2547 scope.go:117] "RemoveContainer" containerID="2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e" Sep 08 06:39:46.167962 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:39:46.167936 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e\": container with ID starting with 2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e not found: ID does not exist" containerID="2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e" Sep 08 06:39:46.168048 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.167971 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e"} err="failed to get container status \"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e\": rpc error: code = NotFound desc = could not find container \"2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e\": container with ID starting with 2980d61c84ef2d3fcee651c84476dbbdf69a7b0eb5a4163dac8f3ca9b3970c8e not found: ID does not exist" Sep 08 06:39:46.177057 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.177033 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:39:46.180950 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:46.180929 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5df9544b5f-lgx7v"] Sep 08 06:39:47.619862 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:47.619831 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:39:47.620915 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:47.620881 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:39:47.629927 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:47.629900 2547 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 06:39:47.688122 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:39:47.687987 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c20a93a-35fb-46f0-88a4-a6a12241e138" path="/var/lib/kubelet/pods/4c20a93a-35fb-46f0-88a4-a6a12241e138/volumes" Sep 08 06:41:26.813527 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.813490 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845f77959b-fpv8t"] Sep 08 06:41:26.814070 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.813950 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c20a93a-35fb-46f0-88a4-a6a12241e138" containerName="console" Sep 08 06:41:26.814070 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.813971 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c20a93a-35fb-46f0-88a4-a6a12241e138" containerName="console" Sep 08 06:41:26.814188 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.814073 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c20a93a-35fb-46f0-88a4-a6a12241e138" containerName="console" Sep 08 06:41:26.816979 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.816954 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.844215 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.844181 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845f77959b-fpv8t"] Sep 08 06:41:26.854988 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.854947 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.854988 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.854985 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-oauth-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.855202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.855012 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-service-ca\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.855202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.855030 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcckg\" (UniqueName: \"kubernetes.io/projected/71718b8a-85c7-49cb-bdc4-e081c87a8042-kube-api-access-fcckg\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.855202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.855046 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-trusted-ca-bundle\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.855202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.855084 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-oauth-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.855202 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.855117 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955729 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955679 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955764 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-oauth-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955813 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-service-ca\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955840 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcckg\" (UniqueName: \"kubernetes.io/projected/71718b8a-85c7-49cb-bdc4-e081c87a8042-kube-api-access-fcckg\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955869 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-trusted-ca-bundle\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.955943 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955909 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-oauth-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.956208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.955951 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.956640 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.956615 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-service-ca\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.956775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.956703 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-oauth-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.956775 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.956743 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.957070 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.957038 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71718b8a-85c7-49cb-bdc4-e081c87a8042-trusted-ca-bundle\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.958454 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.958422 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-serving-cert\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.958570 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.958450 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71718b8a-85c7-49cb-bdc4-e081c87a8042-console-oauth-config\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:26.964608 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:26.964579 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcckg\" (UniqueName: \"kubernetes.io/projected/71718b8a-85c7-49cb-bdc4-e081c87a8042-kube-api-access-fcckg\") pod \"console-845f77959b-fpv8t\" (UID: \"71718b8a-85c7-49cb-bdc4-e081c87a8042\") " pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:27.126597 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:27.126498 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:27.405803 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:27.405698 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845f77959b-fpv8t"] Sep 08 06:41:27.409157 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:41:27.409116 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71718b8a_85c7_49cb_bdc4_e081c87a8042.slice/crio-ecc8baa6266efcf8fd17dd7ea9d6725303318a877fad93691bbe3f750bfe7a33 WatchSource:0}: Error finding container ecc8baa6266efcf8fd17dd7ea9d6725303318a877fad93691bbe3f750bfe7a33: Status 404 returned error can't find the container with id ecc8baa6266efcf8fd17dd7ea9d6725303318a877fad93691bbe3f750bfe7a33 Sep 08 06:41:27.562814 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:27.562763 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845f77959b-fpv8t" event={"ID":"71718b8a-85c7-49cb-bdc4-e081c87a8042","Type":"ContainerStarted","Data":"290c25ee745b7b9289841499e38e99a8d608b7bfa36dd1cd8d8592db595aeb20"} Sep 08 06:41:27.563002 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:27.562868 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845f77959b-fpv8t" event={"ID":"71718b8a-85c7-49cb-bdc4-e081c87a8042","Type":"ContainerStarted","Data":"ecc8baa6266efcf8fd17dd7ea9d6725303318a877fad93691bbe3f750bfe7a33"} Sep 08 06:41:27.581429 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:27.581370 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845f77959b-fpv8t" podStartSLOduration=1.581352942 podStartE2EDuration="1.581352942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:41:27.581244878 +0000 UTC m=+400.390353458" watchObservedRunningTime="2026-09-08 06:41:27.581352942 +0000 UTC m=+400.390461527" Sep 08 06:41:37.127574 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:37.127527 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:37.128079 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:37.127598 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:37.132852 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:37.132825 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:37.610165 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:37.610129 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845f77959b-fpv8t" Sep 08 06:41:37.669267 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:41:37.669233 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:42:02.694045 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:02.694003 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84b79b6786-gnzh9" podUID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" containerName="console" containerID="cri-o://d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d" gracePeriod=15 Sep 08 06:42:02.942693 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:02.942665 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:42:03.078626 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078587 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsvpg\" (UniqueName: \"kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078626 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078645 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078903 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078683 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078903 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078776 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078903 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078818 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078903 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078844 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.078903 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.078873 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert\") pod \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\" (UID: \"d3d1e773-3ba2-4264-a46d-6ed3f36c551f\") " Sep 08 06:42:03.079178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079157 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config" (OuterVolumeSpecName: "console-config") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:42:03.079337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079274 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:42:03.079337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079284 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:42:03.079337 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079270 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:42:03.079519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079450 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.079519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079470 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-trusted-ca-bundle\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.079519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079483 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-service-ca\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.079519 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.079496 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-oauth-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.080931 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.080904 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:42:03.081351 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.081330 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg" (OuterVolumeSpecName: "kube-api-access-nsvpg") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "kube-api-access-nsvpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:42:03.081424 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.081332 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3d1e773-3ba2-4264-a46d-6ed3f36c551f" (UID: "d3d1e773-3ba2-4264-a46d-6ed3f36c551f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:42:03.179939 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.179896 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-oauth-config\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.179939 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.179929 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsvpg\" (UniqueName: \"kubernetes.io/projected/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-kube-api-access-nsvpg\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.179939 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.179940 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3d1e773-3ba2-4264-a46d-6ed3f36c551f-console-serving-cert\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:42:03.708207 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.708172 2547 generic.go:356] "Generic (PLEG): container finished" podID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" containerID="d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d" exitCode=0 Sep 08 06:42:03.708598 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.708218 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b79b6786-gnzh9" Sep 08 06:42:03.708598 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.708223 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b79b6786-gnzh9" event={"ID":"d3d1e773-3ba2-4264-a46d-6ed3f36c551f","Type":"ContainerDied","Data":"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d"} Sep 08 06:42:03.708598 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.708330 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b79b6786-gnzh9" event={"ID":"d3d1e773-3ba2-4264-a46d-6ed3f36c551f","Type":"ContainerDied","Data":"f8d7209c21ce17d676dcb6ec70770c4f027bd3496a4c1dd66ff6e33f65d8dab2"} Sep 08 06:42:03.708598 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.708360 2547 scope.go:117] "RemoveContainer" containerID="d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d" Sep 08 06:42:03.716781 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.716761 2547 scope.go:117] "RemoveContainer" containerID="d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d" Sep 08 06:42:03.717086 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:42:03.717064 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d\": container with ID starting with d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d not found: ID does not exist" containerID="d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d" Sep 08 06:42:03.717133 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.717095 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d"} err="failed to get container status \"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d\": rpc error: code = NotFound desc = could not find container \"d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d\": container with ID starting with d91acce3851847fd89f8576950104e11c51d1cc087a4f9f09e28657c5f26567d not found: ID does not exist" Sep 08 06:42:03.723148 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.723123 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:42:03.726098 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:03.726073 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b79b6786-gnzh9"] Sep 08 06:42:05.687805 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:42:05.687770 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" path="/var/lib/kubelet/pods/d3d1e773-3ba2-4264-a46d-6ed3f36c551f/volumes" Sep 08 06:44:47.646303 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:44:47.646266 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:44:47.646844 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:44:47.646623 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:48:33.924092 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.924057 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-xfhrl"] Sep 08 06:48:33.924512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.924349 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" containerName="console" Sep 08 06:48:33.924512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.924362 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" containerName="console" Sep 08 06:48:33.924512 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.924443 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d1e773-3ba2-4264-a46d-6ed3f36c551f" containerName="console" Sep 08 06:48:33.927340 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.927323 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:33.929640 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.929617 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 06:48:33.930312 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.930295 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 06:48:33.930390 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.930320 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-vq7hc\"" Sep 08 06:48:33.930390 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.930320 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 06:48:33.936328 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.936301 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-xfhrl"] Sep 08 06:48:33.938610 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:33.938574 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9px7s\" (UniqueName: \"kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s\") pod \"feast-test-apply-xfhrl\" (UID: \"49d77065-869d-4930-bdf7-ba2cf6a95a33\") " pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:34.039684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:34.039642 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9px7s\" (UniqueName: \"kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s\") pod \"feast-test-apply-xfhrl\" (UID: \"49d77065-869d-4930-bdf7-ba2cf6a95a33\") " pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:34.048053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:34.048026 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9px7s\" (UniqueName: \"kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s\") pod \"feast-test-apply-xfhrl\" (UID: \"49d77065-869d-4930-bdf7-ba2cf6a95a33\") " pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:34.245746 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:34.245625 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:34.516028 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:34.515932 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-xfhrl"] Sep 08 06:48:34.520198 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:48:34.520174 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49d77065_869d_4930_bdf7_ba2cf6a95a33.slice/crio-4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121 WatchSource:0}: Error finding container 4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121: Status 404 returned error can't find the container with id 4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121 Sep 08 06:48:34.522754 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:34.522730 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:48:35.213869 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:35.213833 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerStarted","Data":"4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121"} Sep 08 06:48:40.236015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:40.235930 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerStarted","Data":"414a3a54090ca7cb615d5f3af5f293b7d7e27aa6044c71be8b4be2a8926d100b"} Sep 08 06:48:47.264973 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:47.264932 2547 generic.go:356] "Generic (PLEG): container finished" podID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerID="414a3a54090ca7cb615d5f3af5f293b7d7e27aa6044c71be8b4be2a8926d100b" exitCode=0 Sep 08 06:48:47.265349 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:47.265005 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerDied","Data":"414a3a54090ca7cb615d5f3af5f293b7d7e27aa6044c71be8b4be2a8926d100b"} Sep 08 06:48:48.271375 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:48.271335 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerStarted","Data":"92b504f6ccb162f1ab956e73ce112d98e919048a288311ee2aba2d04846f58ba"} Sep 08 06:48:48.287409 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:48.287347 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-xfhrl" podStartSLOduration=3.511399906 podStartE2EDuration="15.287324748s" totalImagesPullingTime="5.311616537s" totalInitContainerRuntime="6.464308305s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:48:48.286889564 +0000 UTC m=+841.095998146" watchObservedRunningTime="2026-09-08 06:48:48.287324748 +0000 UTC m=+841.096433329" Sep 08 06:48:57.310423 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:57.310387 2547 generic.go:356] "Generic (PLEG): container finished" podID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerID="92b504f6ccb162f1ab956e73ce112d98e919048a288311ee2aba2d04846f58ba" exitCode=0 Sep 08 06:48:57.310854 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:57.310460 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerDied","Data":"92b504f6ccb162f1ab956e73ce112d98e919048a288311ee2aba2d04846f58ba"} Sep 08 06:48:58.448726 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:58.448678 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:58.556220 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:58.556184 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9px7s\" (UniqueName: \"kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s\") pod \"49d77065-869d-4930-bdf7-ba2cf6a95a33\" (UID: \"49d77065-869d-4930-bdf7-ba2cf6a95a33\") " Sep 08 06:48:58.558448 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:58.558418 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s" (OuterVolumeSpecName: "kube-api-access-9px7s") pod "49d77065-869d-4930-bdf7-ba2cf6a95a33" (UID: "49d77065-869d-4930-bdf7-ba2cf6a95a33"). InnerVolumeSpecName "kube-api-access-9px7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:48:58.657128 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:58.657036 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9px7s\" (UniqueName: \"kubernetes.io/projected/49d77065-869d-4930-bdf7-ba2cf6a95a33-kube-api-access-9px7s\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:48:59.319618 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:59.319591 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-xfhrl" Sep 08 06:48:59.319801 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:59.319585 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-xfhrl" event={"ID":"49d77065-869d-4930-bdf7-ba2cf6a95a33","Type":"ContainerDied","Data":"4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121"} Sep 08 06:48:59.319801 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:59.319701 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c0dc0fe0acb5cc333a8ff60061343f2fdbc30703a80bdb6d0ed9a3a6040f121" Sep 08 06:48:59.495961 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:59.495928 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-xfhrl_49d77065-869d-4930-bdf7-ba2cf6a95a33/feast-0/0.log" Sep 08 06:48:59.501619 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:48:59.501600 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-xfhrl_49d77065-869d-4930-bdf7-ba2cf6a95a33/feast-1/0.log" Sep 08 06:49:36.673154 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:49:36.673109 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-xfhrl"] Sep 08 06:49:36.682845 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:49:36.682811 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-xfhrl"] Sep 08 06:49:37.687138 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:49:37.687099 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" path="/var/lib/kubelet/pods/49d77065-869d-4930-bdf7-ba2cf6a95a33/volumes" Sep 08 06:49:47.671228 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:49:47.671148 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:49:47.672307 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:49:47.672283 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:54:35.941260 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941226 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 06:54:35.941705 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941517 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerName="feast-1" Sep 08 06:54:35.941705 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941527 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerName="feast-1" Sep 08 06:54:35.941705 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941545 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerName="feast-0" Sep 08 06:54:35.941705 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941550 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerName="feast-0" Sep 08 06:54:35.941705 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.941604 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d77065-869d-4930-bdf7-ba2cf6a95a33" containerName="feast-1" Sep 08 06:54:35.944513 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.944498 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:35.947931 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.947910 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 06:54:35.948435 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.948419 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pvskl\"" Sep 08 06:54:35.948659 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.948645 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 06:54:35.971665 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:35.971639 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 06:54:36.036765 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.036729 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8cd\" (UniqueName: \"kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd\") pod \"feast-operator-controller-manager-689b877b4b-5xf7h\" (UID: \"508d5d7f-a5c4-4442-a0ab-74a960593771\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:36.137551 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.137512 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8cd\" (UniqueName: \"kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd\") pod \"feast-operator-controller-manager-689b877b4b-5xf7h\" (UID: \"508d5d7f-a5c4-4442-a0ab-74a960593771\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:36.147298 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.147273 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8cd\" (UniqueName: \"kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd\") pod \"feast-operator-controller-manager-689b877b4b-5xf7h\" (UID: \"508d5d7f-a5c4-4442-a0ab-74a960593771\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:36.254434 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.254345 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:36.525524 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.525476 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 06:54:36.528140 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:54:36.528112 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508d5d7f_a5c4_4442_a0ab_74a960593771.slice/crio-33890d287117a0f5ea531b8fa7ca951c13d1639b4d9d994c13b31be2b0efa8ab WatchSource:0}: Error finding container 33890d287117a0f5ea531b8fa7ca951c13d1639b4d9d994c13b31be2b0efa8ab: Status 404 returned error can't find the container with id 33890d287117a0f5ea531b8fa7ca951c13d1639b4d9d994c13b31be2b0efa8ab Sep 08 06:54:36.530028 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.530006 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:54:36.652866 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:36.652831 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" event={"ID":"508d5d7f-a5c4-4442-a0ab-74a960593771","Type":"ContainerStarted","Data":"33890d287117a0f5ea531b8fa7ca951c13d1639b4d9d994c13b31be2b0efa8ab"} Sep 08 06:54:39.669153 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:39.669108 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" event={"ID":"508d5d7f-a5c4-4442-a0ab-74a960593771","Type":"ContainerStarted","Data":"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43"} Sep 08 06:54:39.669585 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:39.669249 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:39.691689 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:39.691641 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" podStartSLOduration=2.425869945 podStartE2EDuration="4.691626669s" totalImagesPullingTime="2.265756724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:54:39.690753357 +0000 UTC m=+1192.499861939" watchObservedRunningTime="2026-09-08 06:54:39.691626669 +0000 UTC m=+1192.500735249" Sep 08 06:54:47.698128 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:47.698094 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:54:47.698918 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:47.698890 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:54:47.742627 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:47.742589 2547 scope.go:117] "RemoveContainer" containerID="92b504f6ccb162f1ab956e73ce112d98e919048a288311ee2aba2d04846f58ba" Sep 08 06:54:47.751027 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:47.751004 2547 scope.go:117] "RemoveContainer" containerID="414a3a54090ca7cb615d5f3af5f293b7d7e27aa6044c71be8b4be2a8926d100b" Sep 08 06:54:50.677487 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:50.677449 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 06:54:52.843255 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.843212 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:54:52.850704 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.850674 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.853642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853334 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 06:54:52.853642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853435 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 06:54:52.853642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853474 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 06:54:52.853642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853339 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 06:54:52.853642 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853435 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 06:54:52.854010 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853750 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-h7rbn\"" Sep 08 06:54:52.854010 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.853784 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 06:54:52.859191 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.859134 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:54:52.980992 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.980956 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.980992 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.980994 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqsp\" (UniqueName: \"kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.981281 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.981027 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.981281 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.981203 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.981281 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.981257 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:52.981435 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:52.981310 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082501 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082457 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082517 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082546 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082604 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082631 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqsp\" (UniqueName: \"kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:54:53.082642 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 06:54:53.082728 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082667 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.083048 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:54:53.082737 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls podName:7b1446f0-1405-42b8-b4e7-7f712ee804a8 nodeName:}" failed. No retries permitted until 2026-09-08 06:54:53.582697729 +0000 UTC m=+1206.391806309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-cf9nr" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 06:54:53.083048 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:54:53.082783 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 08 06:54:53.083048 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:54:53.082838 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls podName:7b1446f0-1405-42b8-b4e7-7f712ee804a8 nodeName:}" failed. No retries permitted until 2026-09-08 06:54:53.582820852 +0000 UTC m=+1206.391929416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-cf9nr" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8") : secret "feast-simple-feast-setup-offline-tls" not found Sep 08 06:54:53.083048 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.082972 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.085182 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.085157 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.085452 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.085436 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.093399 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.093327 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqsp\" (UniqueName: \"kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.586843 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.586799 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.587096 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.586867 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.589353 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.589315 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.589353 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.589332 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cf9nr\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:53.774722 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:53.774656 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:54:54.052815 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:54.052787 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:54:54.054982 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:54:54.054958 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b1446f0_1405_42b8_b4e7_7f712ee804a8.slice/crio-e31649071a4d2a56ce072b7f8ce19a5a90ae74f4222b9b9dcba7641d6ab9ee7d WatchSource:0}: Error finding container e31649071a4d2a56ce072b7f8ce19a5a90ae74f4222b9b9dcba7641d6ab9ee7d: Status 404 returned error can't find the container with id e31649071a4d2a56ce072b7f8ce19a5a90ae74f4222b9b9dcba7641d6ab9ee7d Sep 08 06:54:54.734566 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:54:54.734172 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"e31649071a4d2a56ce072b7f8ce19a5a90ae74f4222b9b9dcba7641d6ab9ee7d"} Sep 08 06:55:07.800331 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:07.800290 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"51e6f83c786957802cac244536ee388dc1556fc969d70efa63d5c4e21e075dbb"} Sep 08 06:55:12.821785 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:12.821747 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="51e6f83c786957802cac244536ee388dc1556fc969d70efa63d5c4e21e075dbb" exitCode=0 Sep 08 06:55:12.822195 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:12.821804 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"51e6f83c786957802cac244536ee388dc1556fc969d70efa63d5c4e21e075dbb"} Sep 08 06:55:13.828695 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:13.828659 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"621e1ce490f6d1009dc7636da9173ccb2ed555a343659de5afe1b5fffdc1d3ab"} Sep 08 06:55:19.855446 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:19.855410 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="621e1ce490f6d1009dc7636da9173ccb2ed555a343659de5afe1b5fffdc1d3ab" exitCode=0 Sep 08 06:55:19.855830 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:19.855481 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"621e1ce490f6d1009dc7636da9173ccb2ed555a343659de5afe1b5fffdc1d3ab"} Sep 08 06:55:20.865771 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:20.865700 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"fecfcaf5871032064f45f57e9fd31680d7e2018884569de9a11d9235e9a2ecb6"} Sep 08 06:55:20.866247 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:20.865794 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"d6e5f5a0988d3291f41b8c81a5d8e43c3d41771bea492a98f556b5bd2ae8dbea"} Sep 08 06:55:20.866247 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:20.865818 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"7f8dbe9744f766365cdcf055ac5685e298e289edb47740d9b8835f69f713a057"} Sep 08 06:55:20.866247 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:20.865837 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerStarted","Data":"df7729e66fa74ee3de919d4d5f35d52faad5108ae105646f393619bd5d160522"} Sep 08 06:55:20.901206 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:20.901128 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podStartSLOduration=15.561379533 podStartE2EDuration="28.901104138s" totalImagesPullingTime="13.339724605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:55:20.898973174 +0000 UTC m=+1233.708081784" watchObservedRunningTime="2026-09-08 06:55:20.901104138 +0000 UTC m=+1233.710212719" Sep 08 06:55:23.775466 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775425 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775563 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775584 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775600 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775630 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775647 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775665 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.775942 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.775680 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:23.777178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.777044 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Sep 08 06:55:23.777178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.777081 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 06:55:23.777178 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.777115 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Sep 08 06:55:23.777454 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:23.777430 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 06:55:26.776053 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:26.775993 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 06:55:26.776579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:26.776001 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 06:55:26.776579 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:26.776522 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Sep 08 06:55:26.776732 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:26.776634 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Sep 08 06:55:29.776549 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.776506 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.777156 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.776790 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.777244 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.777220 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.777332 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.777305 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.777390 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.777348 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.782377 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.782349 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.917209 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.917182 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:55:29.920302 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:55:29.920271 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:56:31.272087 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.272045 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:56:31.272652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.272407 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" containerID="cri-o://df7729e66fa74ee3de919d4d5f35d52faad5108ae105646f393619bd5d160522" gracePeriod=30 Sep 08 06:56:31.272652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.272442 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" containerID="cri-o://fecfcaf5871032064f45f57e9fd31680d7e2018884569de9a11d9235e9a2ecb6" gracePeriod=30 Sep 08 06:56:31.272652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.272504 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" containerID="cri-o://7f8dbe9744f766365cdcf055ac5685e298e289edb47740d9b8835f69f713a057" gracePeriod=30 Sep 08 06:56:31.272652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.272449 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" containerID="cri-o://d6e5f5a0988d3291f41b8c81a5d8e43c3d41771bea492a98f556b5bd2ae8dbea" gracePeriod=30 Sep 08 06:56:31.651555 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.651513 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 06:56:31.655688 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.655663 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.657953 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.657924 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-q7kkl\"" Sep 08 06:56:31.670521 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.670490 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 06:56:31.770381 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770339 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.770381 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770389 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qf8\" (UniqueName: \"kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.770652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770427 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.770652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770515 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.770652 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770562 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.770827 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.770679 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871623 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871573 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871623 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871618 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qf8\" (UniqueName: \"kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871623 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871637 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871963 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871766 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871963 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:56:31.871778 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 06:56:31.871963 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871801 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.871963 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:56:31.871865 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls podName:f040d4c8-337d-46ee-8b4e-e7b6247e4363 nodeName:}" failed. No retries permitted until 2026-09-08 06:56:32.371840952 +0000 UTC m=+1305.180949534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-w2qqr" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 06:56:31.871963 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.871915 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.872226 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.872071 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.874988 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.874961 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.875143 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.874995 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.875421 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.875395 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:31.881944 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:31.881915 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qf8\" (UniqueName: \"kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:32.167018 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.166987 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="fecfcaf5871032064f45f57e9fd31680d7e2018884569de9a11d9235e9a2ecb6" exitCode=0 Sep 08 06:56:32.167214 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.167056 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"fecfcaf5871032064f45f57e9fd31680d7e2018884569de9a11d9235e9a2ecb6"} Sep 08 06:56:32.376989 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.376950 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:32.379481 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.379457 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-w2qqr\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:32.567264 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.567217 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:32.847667 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:32.847635 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 06:56:32.848972 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:56:32.848944 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf040d4c8_337d_46ee_8b4e_e7b6247e4363.slice/crio-6ee1f37e509c2f953461fde129dce1a2a55b4ff0639cca81c8b6d241c7d0ac20 WatchSource:0}: Error finding container 6ee1f37e509c2f953461fde129dce1a2a55b4ff0639cca81c8b6d241c7d0ac20: Status 404 returned error can't find the container with id 6ee1f37e509c2f953461fde129dce1a2a55b4ff0639cca81c8b6d241c7d0ac20 Sep 08 06:56:33.175027 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:33.174910 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557"} Sep 08 06:56:33.175027 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:33.174979 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"6ee1f37e509c2f953461fde129dce1a2a55b4ff0639cca81c8b6d241c7d0ac20"} Sep 08 06:56:33.181275 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:33.181237 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="7f8dbe9744f766365cdcf055ac5685e298e289edb47740d9b8835f69f713a057" exitCode=0 Sep 08 06:56:33.181370 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:33.181347 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"7f8dbe9744f766365cdcf055ac5685e298e289edb47740d9b8835f69f713a057"} Sep 08 06:56:38.204946 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:38.204904 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557" exitCode=0 Sep 08 06:56:38.205370 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:38.204983 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557"} Sep 08 06:56:39.211504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:39.211469 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186"} Sep 08 06:56:39.777665 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:39.777615 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 06:56:39.917142 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:39.917086 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 06:56:45.239415 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:45.239378 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186" exitCode=0 Sep 08 06:56:45.239820 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:45.239423 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186"} Sep 08 06:56:46.250391 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:46.250346 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca"} Sep 08 06:56:46.250915 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:46.250411 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b"} Sep 08 06:56:46.250915 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:46.250434 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c"} Sep 08 06:56:46.250915 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:46.250453 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerStarted","Data":"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d"} Sep 08 06:56:46.273997 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:46.273919 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podStartSLOduration=15.273892342 podStartE2EDuration="15.273892342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:56:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:56:46.272180815 +0000 UTC m=+1319.081289402" watchObservedRunningTime="2026-09-08 06:56:46.273892342 +0000 UTC m=+1319.083000923" Sep 08 06:56:47.569212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.568166 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:47.569212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.568238 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:47.569212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.568261 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:47.569212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.568824 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:47.570445 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.570408 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused" Sep 08 06:56:47.570569 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.570443 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 08 06:56:47.570569 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.570498 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 06:56:47.570569 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:47.570522 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 08 06:56:49.778016 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:49.777964 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 06:56:49.918021 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:49.917969 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 06:56:50.568150 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:50.568098 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused" Sep 08 06:56:50.568350 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:50.568106 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 08 06:56:50.568350 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:50.568105 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 06:56:50.568494 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:50.568127 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 08 06:56:52.567702 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:52.567663 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:52.568300 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:52.568271 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:52.568300 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:52.568307 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:52.568508 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:52.568325 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:53.568423 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.568068 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 06:56:53.568934 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.568814 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:53.569023 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.569005 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:53.569722 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.569683 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:53.569897 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.569871 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:53.574737 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:53.574704 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:54.302142 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:54.302111 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:56.569009 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:56.568971 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:57.310959 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:57.310927 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 06:56:59.778015 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:59.777971 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 06:56:59.778502 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:59.778104 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:56:59.916967 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:59.916922 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 06:56:59.917240 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:56:59.917067 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:57:01.333843 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.333809 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="d6e5f5a0988d3291f41b8c81a5d8e43c3d41771bea492a98f556b5bd2ae8dbea" exitCode=137 Sep 08 06:57:01.333843 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.333837 2547 generic.go:356] "Generic (PLEG): container finished" podID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerID="df7729e66fa74ee3de919d4d5f35d52faad5108ae105646f393619bd5d160522" exitCode=137 Sep 08 06:57:01.333843 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.333833 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"d6e5f5a0988d3291f41b8c81a5d8e43c3d41771bea492a98f556b5bd2ae8dbea"} Sep 08 06:57:01.334278 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.333881 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"df7729e66fa74ee3de919d4d5f35d52faad5108ae105646f393619bd5d160522"} Sep 08 06:57:01.920976 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.920948 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:57:01.958043 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958007 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958049 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggqsp\" (UniqueName: \"kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958080 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958115 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958135 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958208 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958160 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls\") pod \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\" (UID: \"7b1446f0-1405-42b8-b4e7-7f712ee804a8\") " Sep 08 06:57:01.958829 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.958789 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data" (OuterVolumeSpecName: "feast-data") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:57:01.960667 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.960629 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp" (OuterVolumeSpecName: "kube-api-access-ggqsp") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "kube-api-access-ggqsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:57:01.960900 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.960871 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls" (OuterVolumeSpecName: "online-tls") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:57:01.960996 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.960894 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:57:01.960996 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.960937 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:57:01.960996 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:01.960979 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7b1446f0-1405-42b8-b4e7-7f712ee804a8" (UID: "7b1446f0-1405-42b8-b4e7-7f712ee804a8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059587 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059622 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggqsp\" (UniqueName: \"kubernetes.io/projected/7b1446f0-1405-42b8-b4e7-7f712ee804a8-kube-api-access-ggqsp\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059633 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059645 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059653 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1446f0-1405-42b8-b4e7-7f712ee804a8-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.059684 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.059661 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7b1446f0-1405-42b8-b4e7-7f712ee804a8-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 06:57:02.341000 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.340909 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" Sep 08 06:57:02.341453 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.340913 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr" event={"ID":"7b1446f0-1405-42b8-b4e7-7f712ee804a8","Type":"ContainerDied","Data":"e31649071a4d2a56ce072b7f8ce19a5a90ae74f4222b9b9dcba7641d6ab9ee7d"} Sep 08 06:57:02.341453 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.341059 2547 scope.go:117] "RemoveContainer" containerID="fecfcaf5871032064f45f57e9fd31680d7e2018884569de9a11d9235e9a2ecb6" Sep 08 06:57:02.349921 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.349896 2547 scope.go:117] "RemoveContainer" containerID="d6e5f5a0988d3291f41b8c81a5d8e43c3d41771bea492a98f556b5bd2ae8dbea" Sep 08 06:57:02.358036 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.358016 2547 scope.go:117] "RemoveContainer" containerID="7f8dbe9744f766365cdcf055ac5685e298e289edb47740d9b8835f69f713a057" Sep 08 06:57:02.364911 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.364879 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:57:02.367013 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.366963 2547 scope.go:117] "RemoveContainer" containerID="df7729e66fa74ee3de919d4d5f35d52faad5108ae105646f393619bd5d160522" Sep 08 06:57:02.368504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.368481 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cf9nr"] Sep 08 06:57:02.374981 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.374958 2547 scope.go:117] "RemoveContainer" containerID="621e1ce490f6d1009dc7636da9173ccb2ed555a343659de5afe1b5fffdc1d3ab" Sep 08 06:57:02.382772 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:02.382742 2547 scope.go:117] "RemoveContainer" containerID="51e6f83c786957802cac244536ee388dc1556fc969d70efa63d5c4e21e075dbb" Sep 08 06:57:03.686935 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:57:03.686902 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" path="/var/lib/kubelet/pods/7b1446f0-1405-42b8-b4e7-7f712ee804a8/volumes" Sep 08 06:58:00.674648 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.674601 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675140 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675154 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675168 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675176 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675189 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" Sep 08 06:58:00.675194 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675198 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675214 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675222 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675232 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="feast-apply" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675240 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="feast-apply" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675256 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="feast-init" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675264 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="feast-init" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675335 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="online" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675349 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="offline" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675359 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="ui" Sep 08 06:58:00.675497 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.675369 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1446f0-1405-42b8-b4e7-7f712ee804a8" containerName="registry" Sep 08 06:58:00.680376 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.680353 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.686086 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686053 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 06:58:00.686260 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686097 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 06:58:00.686260 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686159 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-rzd6b\"" Sep 08 06:58:00.686445 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686426 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 06:58:00.686525 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686460 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 06:58:00.686955 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686935 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 06:58:00.687149 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.686940 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 06:58:00.693786 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.693756 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 06:58:00.759078 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759036 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dgp\" (UniqueName: \"kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.759305 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759135 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.759305 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759258 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.759436 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759306 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.759436 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759356 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.759436 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.759380 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860504 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860456 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860513 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860562 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860586 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:58:00.860614 2547 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860625 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dgp\" (UniqueName: \"kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.860751 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:58:00.860691 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls podName:0be329bf-8a8d-43d4-934c-bc346bc5c672 nodeName:}" failed. No retries permitted until 2026-09-08 06:58:01.360666813 +0000 UTC m=+1394.169775375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-lhksc" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 08 06:58:00.861081 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860838 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.861081 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.860970 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.861081 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:58:00.860982 2547 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 06:58:00.861081 ip-10-0-132-183 kubenswrapper[2547]: E0908 06:58:00.861059 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls podName:0be329bf-8a8d-43d4-934c-bc346bc5c672 nodeName:}" failed. No retries permitted until 2026-09-08 06:58:01.36104173 +0000 UTC m=+1394.170150306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-lhksc" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 06:58:00.861565 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.861548 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.863104 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.863077 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:00.870643 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:00.870615 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dgp\" (UniqueName: \"kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.365848 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.365806 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.366035 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.365901 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.368597 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.368565 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.368940 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.368565 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lhksc\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.591147 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.591106 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:01.870301 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:01.870276 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 06:58:01.873077 ip-10-0-132-183 kubenswrapper[2547]: W0908 06:58:01.873050 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0be329bf_8a8d_43d4_934c_bc346bc5c672.slice/crio-e60e137a301567ac7ba567318251784d3d45087eed208c7b45f919d967540edc WatchSource:0}: Error finding container e60e137a301567ac7ba567318251784d3d45087eed208c7b45f919d967540edc: Status 404 returned error can't find the container with id e60e137a301567ac7ba567318251784d3d45087eed208c7b45f919d967540edc Sep 08 06:58:02.591538 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:02.591494 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c"} Sep 08 06:58:02.591730 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:02.591552 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"e60e137a301567ac7ba567318251784d3d45087eed208c7b45f919d967540edc"} Sep 08 06:58:07.623185 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:07.623150 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerID="a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c" exitCode=0 Sep 08 06:58:07.623568 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:07.623194 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c"} Sep 08 06:58:08.630833 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:08.630796 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646"} Sep 08 06:58:31.736916 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:31.736879 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerID="59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646" exitCode=0 Sep 08 06:58:31.737349 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:31.736959 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646"} Sep 08 06:58:32.746809 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:32.746771 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff"} Sep 08 06:58:32.747296 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:32.746828 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be"} Sep 08 06:58:32.747296 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:32.746844 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerStarted","Data":"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a"} Sep 08 06:58:32.775059 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:32.774968 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podStartSLOduration=32.774943859 podStartE2EDuration="32.774943859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:58:32.772380369 +0000 UTC m=+1425.581488950" watchObservedRunningTime="2026-09-08 06:58:32.774943859 +0000 UTC m=+1425.584052440" Sep 08 06:58:34.591844 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.591787 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:34.591844 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.591854 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:34.592391 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.591871 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:34.593571 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.593528 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Sep 08 06:58:34.593750 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.593567 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 06:58:34.593750 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:34.593564 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Sep 08 06:58:37.592183 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:37.592122 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Sep 08 06:58:37.592183 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:37.592160 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Sep 08 06:58:37.592804 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:37.592192 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 06:58:40.592881 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.592801 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:40.593308 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.592935 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:40.593395 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.593368 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:40.593510 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.593443 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:40.593866 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.593847 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:40.593927 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:40.593916 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:41.591376 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:41.591338 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:41.591885 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:41.591840 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 06:58:44.227113 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:44.227078 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:58:44.943287 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:58:44.943254 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 06:59:42.595864 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:42.595818 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 06:59:47.418631 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.418596 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 06:59:47.419163 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.418887 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" containerID="cri-o://4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a" gracePeriod=30 Sep 08 06:59:47.419163 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.418931 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" containerID="cri-o://c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be" gracePeriod=30 Sep 08 06:59:47.419163 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.418905 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" containerID="cri-o://8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff" gracePeriod=30 Sep 08 06:59:47.507784 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.507750 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 06:59:47.508021 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.507981 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" containerID="cri-o://03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" gracePeriod=30 Sep 08 06:59:47.508021 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.508010 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" containerID="cri-o://1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" gracePeriod=30 Sep 08 06:59:47.508212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.508046 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" containerID="cri-o://f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" gracePeriod=30 Sep 08 06:59:47.508212 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.508047 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" containerID="cri-o://3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" gracePeriod=30 Sep 08 06:59:47.732862 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.732771 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:59:47.734203 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:47.734176 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 06:59:49.073836 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.073797 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" exitCode=0 Sep 08 06:59:49.073836 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.073826 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" exitCode=0 Sep 08 06:59:49.074280 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.073870 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca"} Sep 08 06:59:49.074280 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.073924 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c"} Sep 08 06:59:49.076526 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.076499 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerID="8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff" exitCode=0 Sep 08 06:59:49.076526 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.076521 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerID="4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a" exitCode=0 Sep 08 06:59:49.076676 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.076569 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff"} Sep 08 06:59:49.076676 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:49.076606 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a"} Sep 08 06:59:50.593702 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:50.593652 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Sep 08 06:59:54.227982 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:54.227938 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 06:59:54.299541 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:54.299501 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 08 06:59:57.310834 ip-10-0-132-183 kubenswrapper[2547]: I0908 06:59:57.310791 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 07:00:00.594273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:00.594226 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Sep 08 07:00:04.228771 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:04.228681 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 07:00:04.299787 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:04.299743 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 08 07:00:07.310481 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:07.310436 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 07:00:10.593869 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:10.593767 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Sep 08 07:00:10.594278 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:10.593915 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 07:00:14.228394 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:14.228294 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 07:00:14.228830 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:14.228433 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 07:00:14.298959 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:14.298917 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 08 07:00:14.299146 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:14.299045 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 07:00:17.310486 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.310439 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Sep 08 07:00:17.310968 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.310588 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 07:00:17.633473 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.633445 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 07:00:17.701941 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.701906 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.701976 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702015 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7dgp\" (UniqueName: \"kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702059 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702095 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702126 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") pod \"0be329bf-8a8d-43d4-934c-bc346bc5c672\" (UID: \"0be329bf-8a8d-43d4-934c-bc346bc5c672\") " Sep 08 07:00:17.702570 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702503 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 07:00:17.702723 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.702590 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data" (OuterVolumeSpecName: "feast-data") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:00:17.704421 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.704387 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp" (OuterVolumeSpecName: "kube-api-access-v7dgp") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "kube-api-access-v7dgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:00:17.704523 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.704449 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls" (OuterVolumeSpecName: "online-tls") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:17.704668 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.704648 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:17.704898 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.704666 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0be329bf-8a8d-43d4-934c-bc346bc5c672" (UID: "0be329bf-8a8d-43d4-934c-bc346bc5c672"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:17.803741 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803670 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:17.803921 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803811 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:17.803921 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803904 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0be329bf-8a8d-43d4-934c-bc346bc5c672-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:17.804048 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803932 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7dgp\" (UniqueName: \"kubernetes.io/projected/0be329bf-8a8d-43d4-934c-bc346bc5c672-kube-api-access-v7dgp\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:17.804048 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803943 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0be329bf-8a8d-43d4-934c-bc346bc5c672-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:17.804048 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:17.803952 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0be329bf-8a8d-43d4-934c-bc346bc5c672-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.153006 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.152979 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 07:00:18.196082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196043 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" exitCode=137 Sep 08 07:00:18.196082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196075 2547 generic.go:356] "Generic (PLEG): container finished" podID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerID="03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" exitCode=137 Sep 08 07:00:18.196273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196117 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b"} Sep 08 07:00:18.196273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196178 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d"} Sep 08 07:00:18.196273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196127 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" Sep 08 07:00:18.196273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196198 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr" event={"ID":"f040d4c8-337d-46ee-8b4e-e7b6247e4363","Type":"ContainerDied","Data":"6ee1f37e509c2f953461fde129dce1a2a55b4ff0639cca81c8b6d241c7d0ac20"} Sep 08 07:00:18.196273 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.196219 2547 scope.go:117] "RemoveContainer" containerID="1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" Sep 08 07:00:18.199129 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.199102 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerID="c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be" exitCode=137 Sep 08 07:00:18.199255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.199146 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be"} Sep 08 07:00:18.199255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.199176 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" Sep 08 07:00:18.199255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.199184 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc" event={"ID":"0be329bf-8a8d-43d4-934c-bc346bc5c672","Type":"ContainerDied","Data":"e60e137a301567ac7ba567318251784d3d45087eed208c7b45f919d967540edc"} Sep 08 07:00:18.205303 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.205276 2547 scope.go:117] "RemoveContainer" containerID="3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" Sep 08 07:00:18.213774 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.213753 2547 scope.go:117] "RemoveContainer" containerID="f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" Sep 08 07:00:18.222441 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.222421 2547 scope.go:117] "RemoveContainer" containerID="03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" Sep 08 07:00:18.224455 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.224429 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 07:00:18.227056 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.227032 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lhksc"] Sep 08 07:00:18.231659 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.231642 2547 scope.go:117] "RemoveContainer" containerID="50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186" Sep 08 07:00:18.239719 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.239677 2547 scope.go:117] "RemoveContainer" containerID="2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557" Sep 08 07:00:18.250818 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.250790 2547 scope.go:117] "RemoveContainer" containerID="1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" Sep 08 07:00:18.251209 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.251189 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca\": container with ID starting with 1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca not found: ID does not exist" containerID="1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" Sep 08 07:00:18.251298 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251224 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca"} err="failed to get container status \"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca\": rpc error: code = NotFound desc = could not find container \"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca\": container with ID starting with 1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca not found: ID does not exist" Sep 08 07:00:18.251298 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251250 2547 scope.go:117] "RemoveContainer" containerID="3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" Sep 08 07:00:18.251590 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.251572 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b\": container with ID starting with 3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b not found: ID does not exist" containerID="3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" Sep 08 07:00:18.251629 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251600 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b"} err="failed to get container status \"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b\": rpc error: code = NotFound desc = could not find container \"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b\": container with ID starting with 3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b not found: ID does not exist" Sep 08 07:00:18.251629 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251617 2547 scope.go:117] "RemoveContainer" containerID="f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" Sep 08 07:00:18.251914 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.251895 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c\": container with ID starting with f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c not found: ID does not exist" containerID="f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" Sep 08 07:00:18.251979 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251917 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c"} err="failed to get container status \"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c\": rpc error: code = NotFound desc = could not find container \"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c\": container with ID starting with f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c not found: ID does not exist" Sep 08 07:00:18.251979 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.251931 2547 scope.go:117] "RemoveContainer" containerID="03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" Sep 08 07:00:18.252203 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.252184 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d\": container with ID starting with 03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d not found: ID does not exist" containerID="03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" Sep 08 07:00:18.252261 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252207 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d"} err="failed to get container status \"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d\": rpc error: code = NotFound desc = could not find container \"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d\": container with ID starting with 03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d not found: ID does not exist" Sep 08 07:00:18.252261 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252221 2547 scope.go:117] "RemoveContainer" containerID="50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186" Sep 08 07:00:18.252447 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.252429 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186\": container with ID starting with 50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186 not found: ID does not exist" containerID="50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186" Sep 08 07:00:18.252495 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252446 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186"} err="failed to get container status \"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186\": rpc error: code = NotFound desc = could not find container \"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186\": container with ID starting with 50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186 not found: ID does not exist" Sep 08 07:00:18.252495 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252457 2547 scope.go:117] "RemoveContainer" containerID="2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557" Sep 08 07:00:18.252693 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.252675 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557\": container with ID starting with 2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557 not found: ID does not exist" containerID="2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557" Sep 08 07:00:18.252767 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252698 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557"} err="failed to get container status \"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557\": rpc error: code = NotFound desc = could not find container \"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557\": container with ID starting with 2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557 not found: ID does not exist" Sep 08 07:00:18.252767 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252727 2547 scope.go:117] "RemoveContainer" containerID="1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca" Sep 08 07:00:18.252999 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.252982 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca"} err="failed to get container status \"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca\": rpc error: code = NotFound desc = could not find container \"1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca\": container with ID starting with 1d0e73ce5bd6d877a742e447ff8ba6b4aba7d3280d6a47cf568661915af324ca not found: ID does not exist" Sep 08 07:00:18.253050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253000 2547 scope.go:117] "RemoveContainer" containerID="3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b" Sep 08 07:00:18.253238 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253216 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b"} err="failed to get container status \"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b\": rpc error: code = NotFound desc = could not find container \"3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b\": container with ID starting with 3fa66102cf6af555af2f915f2621686f118f1863d0bca595c803961bc3fb027b not found: ID does not exist" Sep 08 07:00:18.253295 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253238 2547 scope.go:117] "RemoveContainer" containerID="f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c" Sep 08 07:00:18.253446 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253429 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c"} err="failed to get container status \"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c\": rpc error: code = NotFound desc = could not find container \"f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c\": container with ID starting with f3a8498a6aa81ecf7dc0016fcd5ff6424af27f600c636a4eda931e788497326c not found: ID does not exist" Sep 08 07:00:18.253446 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253445 2547 scope.go:117] "RemoveContainer" containerID="03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d" Sep 08 07:00:18.253651 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253637 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d"} err="failed to get container status \"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d\": rpc error: code = NotFound desc = could not find container \"03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d\": container with ID starting with 03835a38079eef6fde1af66ae1497f227f3f354f99831c68430c58bd56ae8c7d not found: ID does not exist" Sep 08 07:00:18.253698 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253651 2547 scope.go:117] "RemoveContainer" containerID="50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186" Sep 08 07:00:18.253842 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253822 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186"} err="failed to get container status \"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186\": rpc error: code = NotFound desc = could not find container \"50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186\": container with ID starting with 50c8072cb4bab6706b548807e6b7e70962e1d9a54c52fd46111abc128b47e186 not found: ID does not exist" Sep 08 07:00:18.253894 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.253841 2547 scope.go:117] "RemoveContainer" containerID="2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557" Sep 08 07:00:18.254054 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.254036 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557"} err="failed to get container status \"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557\": rpc error: code = NotFound desc = could not find container \"2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557\": container with ID starting with 2482bb95205978c9849fe71de363797b7ef42cdcad31b24ea8bdd0b9a1ec2557 not found: ID does not exist" Sep 08 07:00:18.254098 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.254054 2547 scope.go:117] "RemoveContainer" containerID="8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff" Sep 08 07:00:18.262859 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.262814 2547 scope.go:117] "RemoveContainer" containerID="c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be" Sep 08 07:00:18.280221 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.280182 2547 scope.go:117] "RemoveContainer" containerID="4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a" Sep 08 07:00:18.292563 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.292534 2547 scope.go:117] "RemoveContainer" containerID="59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646" Sep 08 07:00:18.301034 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.301013 2547 scope.go:117] "RemoveContainer" containerID="a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c" Sep 08 07:00:18.308387 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308356 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.308538 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308397 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.308538 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308430 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.308538 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308447 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4qf8\" (UniqueName: \"kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.308538 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308523 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.308769 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.308545 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data\") pod \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\" (UID: \"f040d4c8-337d-46ee-8b4e-e7b6247e4363\") " Sep 08 07:00:18.309244 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.309216 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data" (OuterVolumeSpecName: "feast-data") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:00:18.309545 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.309518 2547 scope.go:117] "RemoveContainer" containerID="8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff" Sep 08 07:00:18.309959 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.309936 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff\": container with ID starting with 8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff not found: ID does not exist" containerID="8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff" Sep 08 07:00:18.310058 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.309966 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff"} err="failed to get container status \"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff\": rpc error: code = NotFound desc = could not find container \"8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff\": container with ID starting with 8a429f438fbe931f50b54f4ddb401f6252c31a9fef052db5e08523ee2bd02dff not found: ID does not exist" Sep 08 07:00:18.310058 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.309987 2547 scope.go:117] "RemoveContainer" containerID="c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be" Sep 08 07:00:18.310351 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.310324 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be\": container with ID starting with c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be not found: ID does not exist" containerID="c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be" Sep 08 07:00:18.310447 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.310360 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be"} err="failed to get container status \"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be\": rpc error: code = NotFound desc = could not find container \"c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be\": container with ID starting with c873af1818da463998dc45b64ca674557c7cd54563b8ac9bfbf6966c6623a4be not found: ID does not exist" Sep 08 07:00:18.310447 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.310384 2547 scope.go:117] "RemoveContainer" containerID="4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a" Sep 08 07:00:18.310826 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.310799 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a\": container with ID starting with 4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a not found: ID does not exist" containerID="4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.310833 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a"} err="failed to get container status \"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a\": rpc error: code = NotFound desc = could not find container \"4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a\": container with ID starting with 4f1e53326c22b0e58106f56f738358310fa3913da194359dc42c7a3cb6b8901a not found: ID does not exist" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.310859 2547 scope.go:117] "RemoveContainer" containerID="59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311087 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls" (OuterVolumeSpecName: "online-tls") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311147 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311168 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311184 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:00:18.311229 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311185 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8" (OuterVolumeSpecName: "kube-api-access-l4qf8") pod "f040d4c8-337d-46ee-8b4e-e7b6247e4363" (UID: "f040d4c8-337d-46ee-8b4e-e7b6247e4363"). InnerVolumeSpecName "kube-api-access-l4qf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:00:18.311477 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.311304 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646\": container with ID starting with 59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646 not found: ID does not exist" containerID="59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646" Sep 08 07:00:18.311477 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311327 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646"} err="failed to get container status \"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646\": rpc error: code = NotFound desc = could not find container \"59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646\": container with ID starting with 59986a236f2f6620b360b7674019acda2f096366710b8915783d36d84372a646 not found: ID does not exist" Sep 08 07:00:18.311477 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311342 2547 scope.go:117] "RemoveContainer" containerID="a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c" Sep 08 07:00:18.311601 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:18.311584 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c\": container with ID starting with a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c not found: ID does not exist" containerID="a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c" Sep 08 07:00:18.311880 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.311603 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c"} err="failed to get container status \"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c\": rpc error: code = NotFound desc = could not find container \"a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c\": container with ID starting with a0b6e8cafa5d092a66e04009bcd15a38351b46cd86fd59f8df2f15753e9f3f8c not found: ID does not exist" Sep 08 07:00:18.409749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409689 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.409749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409743 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f040d4c8-337d-46ee-8b4e-e7b6247e4363-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.409749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409752 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.409749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409760 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.410010 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409768 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f040d4c8-337d-46ee-8b4e-e7b6247e4363-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.410010 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.409776 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4qf8\" (UniqueName: \"kubernetes.io/projected/f040d4c8-337d-46ee-8b4e-e7b6247e4363-kube-api-access-l4qf8\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:18.521692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.521653 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 07:00:18.525259 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:18.525230 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-w2qqr"] Sep 08 07:00:19.686682 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:19.686649 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" path="/var/lib/kubelet/pods/0be329bf-8a8d-43d4-934c-bc346bc5c672/volumes" Sep 08 07:00:19.687208 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:19.687193 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" path="/var/lib/kubelet/pods/f040d4c8-337d-46ee-8b4e-e7b6247e4363/volumes" Sep 08 07:00:35.855545 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:35.855503 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 07:00:35.856085 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:35.855767 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" podUID="508d5d7f-a5c4-4442-a0ab-74a960593771" containerName="manager" containerID="cri-o://dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43" gracePeriod=10 Sep 08 07:00:36.108084 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.108016 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 07:00:36.264161 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.264123 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx8cd\" (UniqueName: \"kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd\") pod \"508d5d7f-a5c4-4442-a0ab-74a960593771\" (UID: \"508d5d7f-a5c4-4442-a0ab-74a960593771\") " Sep 08 07:00:36.266438 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.266410 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd" (OuterVolumeSpecName: "kube-api-access-hx8cd") pod "508d5d7f-a5c4-4442-a0ab-74a960593771" (UID: "508d5d7f-a5c4-4442-a0ab-74a960593771"). InnerVolumeSpecName "kube-api-access-hx8cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:00:36.283357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.283325 2547 generic.go:356] "Generic (PLEG): container finished" podID="508d5d7f-a5c4-4442-a0ab-74a960593771" containerID="dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43" exitCode=0 Sep 08 07:00:36.283515 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.283366 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" event={"ID":"508d5d7f-a5c4-4442-a0ab-74a960593771","Type":"ContainerDied","Data":"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43"} Sep 08 07:00:36.283515 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.283407 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" event={"ID":"508d5d7f-a5c4-4442-a0ab-74a960593771","Type":"ContainerDied","Data":"33890d287117a0f5ea531b8fa7ca951c13d1639b4d9d994c13b31be2b0efa8ab"} Sep 08 07:00:36.283515 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.283428 2547 scope.go:117] "RemoveContainer" containerID="dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43" Sep 08 07:00:36.283515 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.283370 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h" Sep 08 07:00:36.292173 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.292153 2547 scope.go:117] "RemoveContainer" containerID="dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43" Sep 08 07:00:36.292493 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:36.292469 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43\": container with ID starting with dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43 not found: ID does not exist" containerID="dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43" Sep 08 07:00:36.292558 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.292505 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43"} err="failed to get container status \"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43\": rpc error: code = NotFound desc = could not find container \"dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43\": container with ID starting with dcfe7b810ee81713d97443f8fe786cdf12ed964cf7343427cbaa27a9847cce43 not found: ID does not exist" Sep 08 07:00:36.303772 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.303740 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 07:00:36.307668 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.307639 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5xf7h"] Sep 08 07:00:36.365378 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:36.365293 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx8cd\" (UniqueName: \"kubernetes.io/projected/508d5d7f-a5c4-4442-a0ab-74a960593771-kube-api-access-hx8cd\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:00:37.687492 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:37.687451 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508d5d7f-a5c4-4442-a0ab-74a960593771" path="/var/lib/kubelet/pods/508d5d7f-a5c4-4442-a0ab-74a960593771/volumes" Sep 08 07:00:40.658659 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.658607 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd"] Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659007 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="feast-init" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659020 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="feast-init" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659026 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="feast-apply" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659032 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="feast-apply" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659045 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="feast-init" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659051 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="feast-init" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659062 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="feast-apply" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659067 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="feast-apply" Sep 08 07:00:40.659073 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659074 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659079 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659086 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659091 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659097 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659102 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659108 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659113 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659122 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508d5d7f-a5c4-4442-a0ab-74a960593771" containerName="manager" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659127 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="508d5d7f-a5c4-4442-a0ab-74a960593771" containerName="manager" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659132 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659137 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659144 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659149 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659156 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659161 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659221 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="ui" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659229 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="508d5d7f-a5c4-4442-a0ab-74a960593771" containerName="manager" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659235 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659241 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be329bf-8a8d-43d4-934c-bc346bc5c672" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659246 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="registry" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659252 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="offline" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659259 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="online" Sep 08 07:00:40.659357 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.659264 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f040d4c8-337d-46ee-8b4e-e7b6247e4363" containerName="ui" Sep 08 07:00:40.663436 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.663415 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:40.666000 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.665980 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 07:00:40.666721 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.666687 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 07:00:40.666888 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.666727 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pvskl\"" Sep 08 07:00:40.672001 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.671973 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd"] Sep 08 07:00:40.701637 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.701598 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g259\" (UniqueName: \"kubernetes.io/projected/09fdb2f1-4f2f-468b-973b-2c79c89d00f9-kube-api-access-6g259\") pod \"feast-operator-controller-manager-689b877b4b-pwksd\" (UID: \"09fdb2f1-4f2f-468b-973b-2c79c89d00f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:40.802952 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.802910 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g259\" (UniqueName: \"kubernetes.io/projected/09fdb2f1-4f2f-468b-973b-2c79c89d00f9-kube-api-access-6g259\") pod \"feast-operator-controller-manager-689b877b4b-pwksd\" (UID: \"09fdb2f1-4f2f-468b-973b-2c79c89d00f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:40.812355 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.812325 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g259\" (UniqueName: \"kubernetes.io/projected/09fdb2f1-4f2f-468b-973b-2c79c89d00f9-kube-api-access-6g259\") pod \"feast-operator-controller-manager-689b877b4b-pwksd\" (UID: \"09fdb2f1-4f2f-468b-973b-2c79c89d00f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:40.973969 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:40.973873 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:41.245479 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:41.245398 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd"] Sep 08 07:00:41.248636 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:00:41.248606 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fdb2f1_4f2f_468b_973b_2c79c89d00f9.slice/crio-73c2e7f922be9b0a82a08d70c373f4124d85661e54b9b1c66e1683907b35c8fd WatchSource:0}: Error finding container 73c2e7f922be9b0a82a08d70c373f4124d85661e54b9b1c66e1683907b35c8fd: Status 404 returned error can't find the container with id 73c2e7f922be9b0a82a08d70c373f4124d85661e54b9b1c66e1683907b35c8fd Sep 08 07:00:41.305880 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:41.305850 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" event={"ID":"09fdb2f1-4f2f-468b-973b-2c79c89d00f9","Type":"ContainerStarted","Data":"73c2e7f922be9b0a82a08d70c373f4124d85661e54b9b1c66e1683907b35c8fd"} Sep 08 07:00:42.311551 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:42.311512 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" event={"ID":"09fdb2f1-4f2f-468b-973b-2c79c89d00f9","Type":"ContainerStarted","Data":"eb91d9a151c535375023798787909a6492898573fc52f2c61b1cddc37122f5e0"} Sep 08 07:00:42.311976 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:42.311660 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:42.327061 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:42.327009 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" podStartSLOduration=2.326993494 podStartE2EDuration="2.326993494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:00:42.326606586 +0000 UTC m=+1555.135715168" watchObservedRunningTime="2026-09-08 07:00:42.326993494 +0000 UTC m=+1555.136102074" Sep 08 07:00:53.317748 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:53.317688 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-pwksd" Sep 08 07:00:59.197113 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.197069 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:00:59.201701 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.201679 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.204377 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204352 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 07:00:59.204730 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204646 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 07:00:59.204977 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204662 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 07:00:59.205096 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204439 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 07:00:59.205164 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204786 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 07:00:59.205230 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.204842 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g2tmf\"" Sep 08 07:00:59.205432 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.205412 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 07:00:59.213656 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.213631 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:00:59.258620 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258573 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.258841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258632 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.258841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258755 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.258841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258795 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.258841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258836 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gcv\" (UniqueName: \"kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.259071 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.258882 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.359976 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.359932 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.359976 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.359977 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.360249 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360079 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 07:00:59.360249 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360105 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 08 07:00:59.360249 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360145 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls podName:5f9c3477-f3d8-4e43-83cb-bea23f327477 nodeName:}" failed. No retries permitted until 2026-09-08 07:00:59.860125218 +0000 UTC m=+1572.669233775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls") pod "feast-simple-feast-setup-57576b8fcf-xndp4" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 07:00:59.360249 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360190 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls podName:5f9c3477-f3d8-4e43-83cb-bea23f327477 nodeName:}" failed. No retries permitted until 2026-09-08 07:00:59.860169022 +0000 UTC m=+1572.669277587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-xndp4" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477") : secret "feast-simple-feast-setup-offline-tls" not found Sep 08 07:00:59.360249 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.360222 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.360258 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.360297 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gcv\" (UniqueName: \"kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.360343 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360388 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360417 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls podName:5f9c3477-f3d8-4e43-83cb-bea23f327477 nodeName:}" failed. No retries permitted until 2026-09-08 07:00:59.860408374 +0000 UTC m=+1572.669516932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-xndp4" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360449 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 07:00:59.360532 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:00:59.360469 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls podName:5f9c3477-f3d8-4e43-83cb-bea23f327477 nodeName:}" failed. No retries permitted until 2026-09-08 07:00:59.860463075 +0000 UTC m=+1572.669571632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-xndp4" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 07:00:59.360937 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.360827 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.371648 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.371483 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gcv\" (UniqueName: \"kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.866856 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.866801 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.866856 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.866847 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.867093 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.866895 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.867093 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.866915 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.869624 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.869594 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.869788 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.869653 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.869953 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.869932 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:00:59.869995 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:00:59.869932 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-xndp4\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:00.124348 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:00.124253 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:00.411584 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:00.411368 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:01:00.414239 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:01:00.414207 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f9c3477_f3d8_4e43_83cb_bea23f327477.slice/crio-040817b3777d22741ca630693690a9b60db0a06e759f7a651ff625b3a3bb4f13 WatchSource:0}: Error finding container 040817b3777d22741ca630693690a9b60db0a06e759f7a651ff625b3a3bb4f13: Status 404 returned error can't find the container with id 040817b3777d22741ca630693690a9b60db0a06e759f7a651ff625b3a3bb4f13 Sep 08 07:01:01.389804 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:01.389760 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004"} Sep 08 07:01:01.389804 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:01.389814 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"040817b3777d22741ca630693690a9b60db0a06e759f7a651ff625b3a3bb4f13"} Sep 08 07:01:06.416770 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:06.416730 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004" exitCode=0 Sep 08 07:01:06.416770 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:06.416746 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004"} Sep 08 07:01:07.422649 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:07.422605 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914"} Sep 08 07:01:12.445865 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:12.445827 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914" exitCode=0 Sep 08 07:01:12.445865 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:12.445868 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914"} Sep 08 07:01:13.457260 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:13.457218 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5"} Sep 08 07:01:13.457766 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:13.457281 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90"} Sep 08 07:01:13.457766 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:13.457301 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55"} Sep 08 07:01:13.457766 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:13.457319 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerStarted","Data":"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede"} Sep 08 07:01:13.482796 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:13.482699 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podStartSLOduration=14.482672686 podStartE2EDuration="14.482672686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:01:13.481798428 +0000 UTC m=+1586.290907009" watchObservedRunningTime="2026-09-08 07:01:13.482672686 +0000 UTC m=+1586.291781268" Sep 08 07:01:15.125173 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.125125 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:15.125663 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.125201 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:15.125663 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.125222 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:15.126042 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.126014 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:15.127459 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.127414 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused" Sep 08 07:01:15.127591 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.127457 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused" Sep 08 07:01:15.127591 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.127571 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused" Sep 08 07:01:15.127749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:15.127598 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused" Sep 08 07:01:18.125187 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:18.125120 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused" Sep 08 07:01:18.125187 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:18.125119 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused" Sep 08 07:01:18.125187 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:18.125178 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused" Sep 08 07:01:18.125866 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:18.125612 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused" Sep 08 07:01:20.124680 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:20.124629 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:20.125207 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:20.124704 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:20.125207 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:20.124763 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:20.125207 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:20.124785 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.126061 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.126026 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.126463 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.126244 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.126511 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.126478 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.131382 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.131353 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.508702 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.508617 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.508702 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.508678 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.508927 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.508823 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:01:21.511441 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:01:21.511411 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:02:24.015454 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.015411 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:02:24.016050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.015763 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" containerID="cri-o://a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" gracePeriod=30 Sep 08 07:02:24.016050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.015811 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" containerID="cri-o://e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" gracePeriod=30 Sep 08 07:02:24.016050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.015835 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" containerID="cri-o://42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" gracePeriod=30 Sep 08 07:02:24.016050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.015952 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" containerID="cri-o://7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" gracePeriod=30 Sep 08 07:02:24.384913 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.384873 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:02:24.390069 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.390032 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.393158 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.392959 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-l7jbd\"" Sep 08 07:02:24.409029 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.408991 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:02:24.437439 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437386 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.437439 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437442 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.437729 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437466 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.437729 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437514 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.437729 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437581 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.437729 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.437622 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8l7d\" (UniqueName: \"kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538042 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538001 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538258 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538057 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538258 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538099 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538258 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538173 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538258 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538219 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8l7d\" (UniqueName: \"kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538460 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.538269 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.538460 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:24.538366 2547 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 07:02:24.538460 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:24.538441 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls podName:035d5e44-da6b-4170-8684-ef7f65ec483e nodeName:}" failed. No retries permitted until 2026-09-08 07:02:25.038421546 +0000 UTC m=+1657.847530123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-gvqmh" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 07:02:24.539237 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.539202 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.541463 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.541435 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.541607 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.541436 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.542498 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.542471 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:24.548972 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:24.548945 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8l7d\" (UniqueName: \"kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:25.042586 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.042552 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:25.044875 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.044850 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gvqmh\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:25.303265 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.303163 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:25.581055 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.581026 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:02:25.582467 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:02:25.582441 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod035d5e44_da6b_4170_8684_ef7f65ec483e.slice/crio-180a51c2faddf6aad459e850009e00c6859eb6502c69ce147815b4da70b25aad WatchSource:0}: Error finding container 180a51c2faddf6aad459e850009e00c6859eb6502c69ce147815b4da70b25aad: Status 404 returned error can't find the container with id 180a51c2faddf6aad459e850009e00c6859eb6502c69ce147815b4da70b25aad Sep 08 07:02:25.780261 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.780216 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" exitCode=0 Sep 08 07:02:25.780261 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.780257 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" exitCode=0 Sep 08 07:02:25.780508 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.780282 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5"} Sep 08 07:02:25.780508 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.780326 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55"} Sep 08 07:02:25.782039 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.782013 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"06f737f91225b420f54ae324176c8a8a9e4ad67e6c74107ac0bd489ee779d250"} Sep 08 07:02:25.782189 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:25.782055 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"180a51c2faddf6aad459e850009e00c6859eb6502c69ce147815b4da70b25aad"} Sep 08 07:02:31.508493 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:31.508440 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused" Sep 08 07:02:31.508993 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:31.508462 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused" Sep 08 07:02:31.809010 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:31.808974 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="06f737f91225b420f54ae324176c8a8a9e4ad67e6c74107ac0bd489ee779d250" exitCode=0 Sep 08 07:02:31.809199 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:31.809019 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"06f737f91225b420f54ae324176c8a8a9e4ad67e6c74107ac0bd489ee779d250"} Sep 08 07:02:32.815916 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:32.815881 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"7bf2f26aeb7ee5ae76298a88c4c8c5bf26c183b150191c3fc192bda92913421b"} Sep 08 07:02:38.843665 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:38.843627 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="7bf2f26aeb7ee5ae76298a88c4c8c5bf26c183b150191c3fc192bda92913421b" exitCode=0 Sep 08 07:02:38.844059 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:38.843690 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"7bf2f26aeb7ee5ae76298a88c4c8c5bf26c183b150191c3fc192bda92913421b"} Sep 08 07:02:39.854583 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:39.854538 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"fc4cc7bf66e5e38b2261933dd15296f64efa5fa5332bae11cf9efce763020d8a"} Sep 08 07:02:39.855123 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:39.854614 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"506f09705bfba88302235d5dda213a765f0efc20c13b7fd30e78d9d8af3c0861"} Sep 08 07:02:39.855123 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:39.854641 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"609a3a4cc7cd3bf2031d8796093afcf49613b2d7d7cdd78e010f859acf0b9208"} Sep 08 07:02:39.855123 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:39.854660 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerStarted","Data":"c96718bd80d00311f74bdd9795537d015e4be9298b60c8646d3cfce5be466db3"} Sep 08 07:02:39.894451 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:39.894370 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podStartSLOduration=15.894344057 podStartE2EDuration="15.894344057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:02:39.892617438 +0000 UTC m=+1672.701726021" watchObservedRunningTime="2026-09-08 07:02:39.894344057 +0000 UTC m=+1672.703452651" Sep 08 07:02:40.303900 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.303860 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:40.304192 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.304176 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:40.304366 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.304347 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:40.304476 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.304465 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:40.306583 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.306453 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:02:40.306583 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.306496 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 07:02:40.306583 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.306518 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused" Sep 08 07:02:40.307016 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:40.306981 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:02:41.508882 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:41.508823 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused" Sep 08 07:02:41.509480 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:41.508880 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused" Sep 08 07:02:43.304484 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:43.304432 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 07:02:43.305441 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:43.304432 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:02:43.305592 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:43.304437 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused" Sep 08 07:02:43.305592 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:43.304454 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:02:45.303555 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:45.303456 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:45.305050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:45.304956 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:45.305050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:45.305056 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:45.305050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:45.305079 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:46.304330 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:46.304282 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused" Sep 08 07:02:46.304973 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:46.304282 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 07:02:46.305086 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:46.304295 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:02:46.305086 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:46.304300 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:02:49.304595 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.304559 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.307166 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.305085 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.307166 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.305256 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.307166 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.305359 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.310382 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.310359 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.917783 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.917702 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.918003 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.917935 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:49.920575 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:49.920552 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:02:51.508043 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:51.507997 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused" Sep 08 07:02:51.508503 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:51.508012 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused" Sep 08 07:02:51.508503 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:51.508160 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:02:51.508503 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:51.508232 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:02:54.667224 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.667195 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:02:54.820241 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820143 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820241 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820181 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820241 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820201 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820540 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820253 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gcv\" (UniqueName: \"kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820540 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820297 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820540 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820327 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") pod \"5f9c3477-f3d8-4e43-83cb-bea23f327477\" (UID: \"5f9c3477-f3d8-4e43-83cb-bea23f327477\") " Sep 08 07:02:54.820828 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.820795 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data" (OuterVolumeSpecName: "feast-data") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:02:54.822637 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.822605 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:02:54.822637 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.822617 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv" (OuterVolumeSpecName: "kube-api-access-q2gcv") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "kube-api-access-q2gcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:02:54.822819 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.822677 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:02:54.822819 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.822806 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:02:54.822894 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.822837 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls" (OuterVolumeSpecName: "online-tls") pod "5f9c3477-f3d8-4e43-83cb-bea23f327477" (UID: "5f9c3477-f3d8-4e43-83cb-bea23f327477"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:02:54.921113 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921066 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.921113 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921103 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f9c3477-f3d8-4e43-83cb-bea23f327477-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.921113 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921114 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.921371 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921127 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2gcv\" (UniqueName: \"kubernetes.io/projected/5f9c3477-f3d8-4e43-83cb-bea23f327477-kube-api-access-q2gcv\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.921371 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921139 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.921371 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.921151 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f9c3477-f3d8-4e43-83cb-bea23f327477-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:02:54.940396 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940359 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" exitCode=137 Sep 08 07:02:54.940396 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940386 2547 generic.go:356] "Generic (PLEG): container finished" podID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerID="a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" exitCode=137 Sep 08 07:02:54.940594 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940439 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" Sep 08 07:02:54.940594 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940436 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90"} Sep 08 07:02:54.940594 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940486 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede"} Sep 08 07:02:54.940594 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940501 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4" event={"ID":"5f9c3477-f3d8-4e43-83cb-bea23f327477","Type":"ContainerDied","Data":"040817b3777d22741ca630693690a9b60db0a06e759f7a651ff625b3a3bb4f13"} Sep 08 07:02:54.940594 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.940519 2547 scope.go:117] "RemoveContainer" containerID="7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" Sep 08 07:02:54.949340 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.949318 2547 scope.go:117] "RemoveContainer" containerID="e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" Sep 08 07:02:54.960109 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.958882 2547 scope.go:117] "RemoveContainer" containerID="42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" Sep 08 07:02:54.970365 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.970342 2547 scope.go:117] "RemoveContainer" containerID="a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" Sep 08 07:02:54.972350 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.972325 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:02:54.978329 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.978297 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-xndp4"] Sep 08 07:02:54.980960 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.980939 2547 scope.go:117] "RemoveContainer" containerID="026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914" Sep 08 07:02:54.990747 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:54.990721 2547 scope.go:117] "RemoveContainer" containerID="1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004" Sep 08 07:02:55.000418 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.000392 2547 scope.go:117] "RemoveContainer" containerID="7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" Sep 08 07:02:55.000829 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.000804 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5\": container with ID starting with 7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5 not found: ID does not exist" containerID="7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" Sep 08 07:02:55.000934 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.000846 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5"} err="failed to get container status \"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5\": rpc error: code = NotFound desc = could not find container \"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5\": container with ID starting with 7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5 not found: ID does not exist" Sep 08 07:02:55.000934 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.000875 2547 scope.go:117] "RemoveContainer" containerID="e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" Sep 08 07:02:55.001272 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.001257 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90\": container with ID starting with e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90 not found: ID does not exist" containerID="e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" Sep 08 07:02:55.001340 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001280 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90"} err="failed to get container status \"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90\": rpc error: code = NotFound desc = could not find container \"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90\": container with ID starting with e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90 not found: ID does not exist" Sep 08 07:02:55.001340 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001301 2547 scope.go:117] "RemoveContainer" containerID="42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" Sep 08 07:02:55.001548 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.001530 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55\": container with ID starting with 42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55 not found: ID does not exist" containerID="42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" Sep 08 07:02:55.001596 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001555 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55"} err="failed to get container status \"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55\": rpc error: code = NotFound desc = could not find container \"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55\": container with ID starting with 42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55 not found: ID does not exist" Sep 08 07:02:55.001596 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001578 2547 scope.go:117] "RemoveContainer" containerID="a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" Sep 08 07:02:55.001837 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.001819 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede\": container with ID starting with a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede not found: ID does not exist" containerID="a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" Sep 08 07:02:55.001909 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001841 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede"} err="failed to get container status \"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede\": rpc error: code = NotFound desc = could not find container \"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede\": container with ID starting with a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede not found: ID does not exist" Sep 08 07:02:55.001909 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.001854 2547 scope.go:117] "RemoveContainer" containerID="026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914" Sep 08 07:02:55.002491 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.002473 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914\": container with ID starting with 026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914 not found: ID does not exist" containerID="026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914" Sep 08 07:02:55.002539 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.002495 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914"} err="failed to get container status \"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914\": rpc error: code = NotFound desc = could not find container \"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914\": container with ID starting with 026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914 not found: ID does not exist" Sep 08 07:02:55.002539 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.002508 2547 scope.go:117] "RemoveContainer" containerID="1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004" Sep 08 07:02:55.002760 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:02:55.002744 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004\": container with ID starting with 1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004 not found: ID does not exist" containerID="1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004" Sep 08 07:02:55.002814 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.002764 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004"} err="failed to get container status \"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004\": rpc error: code = NotFound desc = could not find container \"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004\": container with ID starting with 1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004 not found: ID does not exist" Sep 08 07:02:55.002814 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.002782 2547 scope.go:117] "RemoveContainer" containerID="7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5" Sep 08 07:02:55.003010 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.002994 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5"} err="failed to get container status \"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5\": rpc error: code = NotFound desc = could not find container \"7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5\": container with ID starting with 7eb133cdc61721939ed7cef16729d0b0b7497d2119d8f5b5717e1062498092d5 not found: ID does not exist" Sep 08 07:02:55.003050 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003010 2547 scope.go:117] "RemoveContainer" containerID="e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90" Sep 08 07:02:55.003226 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003205 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90"} err="failed to get container status \"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90\": rpc error: code = NotFound desc = could not find container \"e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90\": container with ID starting with e7f95103ed99e92f9960f97d26b1b9909394bd9be9733405ce2853c145602f90 not found: ID does not exist" Sep 08 07:02:55.003299 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003237 2547 scope.go:117] "RemoveContainer" containerID="42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55" Sep 08 07:02:55.003461 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003444 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55"} err="failed to get container status \"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55\": rpc error: code = NotFound desc = could not find container \"42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55\": container with ID starting with 42fe55ed9c4915304007c80b77d27cf4f6767e00445b074091067f9ce43deb55 not found: ID does not exist" Sep 08 07:02:55.003532 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003462 2547 scope.go:117] "RemoveContainer" containerID="a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede" Sep 08 07:02:55.003753 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003737 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede"} err="failed to get container status \"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede\": rpc error: code = NotFound desc = could not find container \"a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede\": container with ID starting with a048f284e17fea26dd17f3d529fe67f6d65a7fd403c5955c5fd0c46aafa29ede not found: ID does not exist" Sep 08 07:02:55.003810 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003754 2547 scope.go:117] "RemoveContainer" containerID="026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914" Sep 08 07:02:55.003966 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003948 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914"} err="failed to get container status \"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914\": rpc error: code = NotFound desc = could not find container \"026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914\": container with ID starting with 026e24766943565155ebae62ce1fee4b67215dfec19b69b60078abf1d9b0f914 not found: ID does not exist" Sep 08 07:02:55.004033 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.003967 2547 scope.go:117] "RemoveContainer" containerID="1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004" Sep 08 07:02:55.004266 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.004246 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004"} err="failed to get container status \"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004\": rpc error: code = NotFound desc = could not find container \"1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004\": container with ID starting with 1abfb79881b59f860a7f896f8879ac532927f426b7599d92eec5ad832384a004 not found: ID does not exist" Sep 08 07:02:55.687983 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:02:55.687948 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" path="/var/lib/kubelet/pods/5f9c3477-f3d8-4e43-83cb-bea23f327477/volumes" Sep 08 07:03:53.122108 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122069 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122408 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122423 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122437 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122443 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122458 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="feast-apply" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122465 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="feast-apply" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122471 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122476 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122488 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122492 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122498 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="feast-init" Sep 08 07:03:53.122537 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122503 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="feast-init" Sep 08 07:03:53.122951 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122549 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="ui" Sep 08 07:03:53.122951 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122559 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="registry" Sep 08 07:03:53.122951 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122565 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="offline" Sep 08 07:03:53.122951 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.122581 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9c3477-f3d8-4e43-83cb-bea23f327477" containerName="online" Sep 08 07:03:53.125977 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.125957 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.128452 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.128423 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 07:03:53.128701 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.128442 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 07:03:53.128854 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.128504 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 07:03:53.128854 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.128585 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 07:03:53.129190 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.129168 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9v2ft\"" Sep 08 07:03:53.129190 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.129183 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 07:03:53.129306 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.129197 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 07:03:53.137783 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.137755 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:03:53.314347 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314307 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.314347 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314356 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.314591 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314423 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.314591 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314438 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.314591 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314478 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.314774 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.314578 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7h6\" (UniqueName: \"kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415603 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415502 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415603 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415543 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415603 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415579 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415954 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415627 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7h6\" (UniqueName: \"kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415954 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415647 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.415954 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.415661 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.416119 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.416077 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.416437 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.416411 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.418140 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.418112 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.418228 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.418175 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.418228 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.418201 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.424345 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.424324 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7h6\" (UniqueName: \"kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-q82t6\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.435278 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.435248 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:03:53.714373 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:53.714337 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:03:53.716546 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:03:53.716509 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c606204_20d2_4eb8_8758_24f63545faba.slice/crio-b1bc11854f77a107de8e2ffb2e959cf673ef8453e111f4214bf991acf06b00a6 WatchSource:0}: Error finding container b1bc11854f77a107de8e2ffb2e959cf673ef8453e111f4214bf991acf06b00a6: Status 404 returned error can't find the container with id b1bc11854f77a107de8e2ffb2e959cf673ef8453e111f4214bf991acf06b00a6 Sep 08 07:03:54.186053 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:54.186006 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe"} Sep 08 07:03:54.186053 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:54.186060 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"b1bc11854f77a107de8e2ffb2e959cf673ef8453e111f4214bf991acf06b00a6"} Sep 08 07:03:59.212575 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:59.212539 2547 generic.go:356] "Generic (PLEG): container finished" podID="1c606204-20d2-4eb8-8758-24f63545faba" containerID="84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe" exitCode=0 Sep 08 07:03:59.212971 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:03:59.212610 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe"} Sep 08 07:04:00.219095 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:00.219055 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446"} Sep 08 07:04:21.308219 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:21.308182 2547 generic.go:356] "Generic (PLEG): container finished" podID="1c606204-20d2-4eb8-8758-24f63545faba" containerID="d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446" exitCode=0 Sep 08 07:04:21.308644 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:21.308254 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446"} Sep 08 07:04:22.317754 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:22.317687 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a"} Sep 08 07:04:22.318245 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:22.317778 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df"} Sep 08 07:04:22.318245 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:22.317797 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerStarted","Data":"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84"} Sep 08 07:04:22.341889 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:22.341831 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podStartSLOduration=29.341812864 podStartE2EDuration="29.341812864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:22.340479874 +0000 UTC m=+1775.149588455" watchObservedRunningTime="2026-09-08 07:04:22.341812864 +0000 UTC m=+1775.150921443" Sep 08 07:04:23.435984 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.435941 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.436570 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.436544 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.436570 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.436575 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.436799 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.436591 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.436799 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.436605 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.436799 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.436621 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:23.438098 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.438068 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused" Sep 08 07:04:23.438215 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.438068 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:04:23.438215 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:23.438120 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:04:26.436533 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:26.436486 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:04:26.436533 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:26.436513 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:04:26.437017 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:26.436485 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused" Sep 08 07:04:29.436102 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:29.436049 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:04:29.436102 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:29.436072 2547 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:04:29.436963 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:29.436939 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:29.437753 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:29.437732 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:32.436488 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:32.436451 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:32.437313 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:32.437290 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:33.090516 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:33.090485 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:34.033040 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:34.033011 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:04:34.439972 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:34.439855 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 07:04:47.765051 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:47.765023 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 07:04:47.767561 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:47.767535 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 07:04:54.440869 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:04:54.440816 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 07:05:14.440911 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:14.440854 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 08 07:05:34.440884 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:34.440830 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 07:05:35.248291 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.248248 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:05:35.248518 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.248492 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" containerID="cri-o://521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84" gracePeriod=30 Sep 08 07:05:35.248590 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.248557 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" containerID="cri-o://60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df" gracePeriod=30 Sep 08 07:05:35.248649 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.248557 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" containerID="cri-o://57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a" gracePeriod=30 Sep 08 07:05:35.407892 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.407853 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:05:35.408173 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.408141 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" containerID="cri-o://c96718bd80d00311f74bdd9795537d015e4be9298b60c8646d3cfce5be466db3" gracePeriod=30 Sep 08 07:05:35.408439 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.408216 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" containerID="cri-o://609a3a4cc7cd3bf2031d8796093afcf49613b2d7d7cdd78e010f859acf0b9208" gracePeriod=30 Sep 08 07:05:35.408569 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.408223 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" containerID="cri-o://506f09705bfba88302235d5dda213a765f0efc20c13b7fd30e78d9d8af3c0861" gracePeriod=30 Sep 08 07:05:35.408661 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:35.408216 2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" containerID="cri-o://fc4cc7bf66e5e38b2261933dd15296f64efa5fa5332bae11cf9efce763020d8a" gracePeriod=30 Sep 08 07:05:36.647777 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.647739 2547 generic.go:356] "Generic (PLEG): container finished" podID="1c606204-20d2-4eb8-8758-24f63545faba" containerID="57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a" exitCode=0 Sep 08 07:05:36.647777 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.647767 2547 generic.go:356] "Generic (PLEG): container finished" podID="1c606204-20d2-4eb8-8758-24f63545faba" containerID="521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84" exitCode=0 Sep 08 07:05:36.648255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.647810 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a"} Sep 08 07:05:36.648255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.647859 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84"} Sep 08 07:05:36.650623 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.650594 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="fc4cc7bf66e5e38b2261933dd15296f64efa5fa5332bae11cf9efce763020d8a" exitCode=0 Sep 08 07:05:36.650623 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.650619 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="609a3a4cc7cd3bf2031d8796093afcf49613b2d7d7cdd78e010f859acf0b9208" exitCode=0 Sep 08 07:05:36.650804 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.650659 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"fc4cc7bf66e5e38b2261933dd15296f64efa5fa5332bae11cf9efce763020d8a"} Sep 08 07:05:36.650804 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:36.650686 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"609a3a4cc7cd3bf2031d8796093afcf49613b2d7d7cdd78e010f859acf0b9208"} Sep 08 07:05:39.918232 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:39.918177 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:05:39.918742 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:39.918187 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:05:42.438022 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:42.437979 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:05:43.371671 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:43.371622 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:05:49.917805 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:49.917756 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:05:49.918231 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:49.917768 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:05:52.437296 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:52.437248 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:05:53.371983 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:53.371927 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:05:59.917925 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:59.917874 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused" Sep 08 07:05:59.918349 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:59.917882 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 07:05:59.918349 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:59.918041 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:05:59.918349 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:05:59.918112 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:06:02.437397 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:02.437346 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused" Sep 08 07:06:02.437841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:02.437474 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:06:03.372095 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:03.372043 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 07:06:03.372291 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:03.372195 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:06:05.448243 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.448217 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:06:05.591879 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.591837 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592097 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.591891 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws7h6\" (UniqueName: \"kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592097 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.591934 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592097 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.591997 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592275 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.592141 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592275 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.592202 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data\") pod \"1c606204-20d2-4eb8-8758-24f63545faba\" (UID: \"1c606204-20d2-4eb8-8758-24f63545faba\") " Sep 08 07:06:05.592388 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.592359 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 07:06:05.592575 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.592545 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1c606204-20d2-4eb8-8758-24f63545faba-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.592840 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.592801 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data" (OuterVolumeSpecName: "feast-data") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:06:05.594366 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.594345 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6" (OuterVolumeSpecName: "kube-api-access-ws7h6") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "kube-api-access-ws7h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:06:05.594450 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.594360 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:05.594450 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.594434 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls" (OuterVolumeSpecName: "online-tls") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:05.594522 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.594468 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1c606204-20d2-4eb8-8758-24f63545faba" (UID: "1c606204-20d2-4eb8-8758-24f63545faba"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:05.693734 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.693688 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.693734 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.693728 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c606204-20d2-4eb8-8758-24f63545faba-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.693734 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.693739 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.693970 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.693755 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7h6\" (UniqueName: \"kubernetes.io/projected/1c606204-20d2-4eb8-8758-24f63545faba-kube-api-access-ws7h6\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.693970 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.693770 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c606204-20d2-4eb8-8758-24f63545faba-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:05.776266 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.776232 2547 generic.go:356] "Generic (PLEG): container finished" podID="1c606204-20d2-4eb8-8758-24f63545faba" containerID="60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df" exitCode=137 Sep 08 07:06:05.776462 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.776294 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" Sep 08 07:06:05.776462 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.776314 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df"} Sep 08 07:06:05.776462 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.776359 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6" event={"ID":"1c606204-20d2-4eb8-8758-24f63545faba","Type":"ContainerDied","Data":"b1bc11854f77a107de8e2ffb2e959cf673ef8453e111f4214bf991acf06b00a6"} Sep 08 07:06:05.776462 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.776380 2547 scope.go:117] "RemoveContainer" containerID="57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a" Sep 08 07:06:05.780213 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.780187 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="506f09705bfba88302235d5dda213a765f0efc20c13b7fd30e78d9d8af3c0861" exitCode=137 Sep 08 07:06:05.780213 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.780212 2547 generic.go:356] "Generic (PLEG): container finished" podID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerID="c96718bd80d00311f74bdd9795537d015e4be9298b60c8646d3cfce5be466db3" exitCode=137 Sep 08 07:06:05.780424 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.780218 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"506f09705bfba88302235d5dda213a765f0efc20c13b7fd30e78d9d8af3c0861"} Sep 08 07:06:05.780424 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.780257 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"c96718bd80d00311f74bdd9795537d015e4be9298b60c8646d3cfce5be466db3"} Sep 08 07:06:05.785369 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.785352 2547 scope.go:117] "RemoveContainer" containerID="60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df" Sep 08 07:06:05.794037 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.794015 2547 scope.go:117] "RemoveContainer" containerID="521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84" Sep 08 07:06:05.795960 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.795934 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:06:05.801208 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.801181 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-q82t6"] Sep 08 07:06:05.803219 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.803201 2547 scope.go:117] "RemoveContainer" containerID="d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446" Sep 08 07:06:05.811309 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.811285 2547 scope.go:117] "RemoveContainer" containerID="84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe" Sep 08 07:06:05.819385 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.819367 2547 scope.go:117] "RemoveContainer" containerID="57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a" Sep 08 07:06:05.819723 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:06:05.819692 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a\": container with ID starting with 57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a not found: ID does not exist" containerID="57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a" Sep 08 07:06:05.819809 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.819735 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a"} err="failed to get container status \"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a\": rpc error: code = NotFound desc = could not find container \"57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a\": container with ID starting with 57b4dc04c1748dae432262bf043afc607774762c688c4ff46bb919c7c769e60a not found: ID does not exist" Sep 08 07:06:05.819809 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.819763 2547 scope.go:117] "RemoveContainer" containerID="60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df" Sep 08 07:06:05.820053 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:06:05.820034 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df\": container with ID starting with 60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df not found: ID does not exist" containerID="60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df" Sep 08 07:06:05.820092 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820060 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df"} err="failed to get container status \"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df\": rpc error: code = NotFound desc = could not find container \"60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df\": container with ID starting with 60482fd9f2d047ec522f8e203c66f6a0a8502a2d5ab77f75e8b61770762125df not found: ID does not exist" Sep 08 07:06:05.820092 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820077 2547 scope.go:117] "RemoveContainer" containerID="521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84" Sep 08 07:06:05.820316 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:06:05.820299 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84\": container with ID starting with 521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84 not found: ID does not exist" containerID="521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84" Sep 08 07:06:05.820381 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820323 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84"} err="failed to get container status \"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84\": rpc error: code = NotFound desc = could not find container \"521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84\": container with ID starting with 521e99ad3b6683491f27cf3153bca5c04b00afce05eefe739b330231a79cae84 not found: ID does not exist" Sep 08 07:06:05.820381 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820341 2547 scope.go:117] "RemoveContainer" containerID="d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446" Sep 08 07:06:05.820579 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:06:05.820561 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446\": container with ID starting with d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446 not found: ID does not exist" containerID="d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446" Sep 08 07:06:05.820620 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820589 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446"} err="failed to get container status \"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446\": rpc error: code = NotFound desc = could not find container \"d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446\": container with ID starting with d4db17246f73d715956fd65dc1565c42f7cba24dfc268dc4bb7fd38a53712446 not found: ID does not exist" Sep 08 07:06:05.820620 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820610 2547 scope.go:117] "RemoveContainer" containerID="84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe" Sep 08 07:06:05.820853 ip-10-0-132-183 kubenswrapper[2547]: E0908 07:06:05.820836 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe\": container with ID starting with 84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe not found: ID does not exist" containerID="84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe" Sep 08 07:06:05.820907 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:05.820856 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe"} err="failed to get container status \"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe\": rpc error: code = NotFound desc = could not find container \"84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe\": container with ID starting with 84e4fc29e5344081c6ccb771b4ba82508f7b99c31723ae81c7234a652e7f8ffe not found: ID does not exist" Sep 08 07:06:06.057191 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.057163 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:06:06.197091 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.196982 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8l7d\" (UniqueName: \"kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197091 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197042 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197091 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197075 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197391 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197119 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197391 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197178 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197391 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197211 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls\") pod \"035d5e44-da6b-4170-8684-ef7f65ec483e\" (UID: \"035d5e44-da6b-4170-8684-ef7f65ec483e\") " Sep 08 07:06:06.197690 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.197651 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data" (OuterVolumeSpecName: "feast-data") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:06:06.199297 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.199273 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d" (OuterVolumeSpecName: "kube-api-access-j8l7d") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "kube-api-access-j8l7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:06:06.199749 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.199700 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:06.199851 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.199775 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:06.199851 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.199811 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:06.199851 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.199826 2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls" (OuterVolumeSpecName: "online-tls") pod "035d5e44-da6b-4170-8684-ef7f65ec483e" (UID: "035d5e44-da6b-4170-8684-ef7f65ec483e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 07:06:06.298785 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298744 2547 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/035d5e44-da6b-4170-8684-ef7f65ec483e-feast-data\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.298785 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298775 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-registry-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.298785 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298784 2547 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-online-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.298785 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298792 2547 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-ui-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.298785 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298799 2547 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/035d5e44-da6b-4170-8684-ef7f65ec483e-offline-tls\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.299093 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.298807 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8l7d\" (UniqueName: \"kubernetes.io/projected/035d5e44-da6b-4170-8684-ef7f65ec483e-kube-api-access-j8l7d\") on node \"ip-10-0-132-183.ec2.internal\" DevicePath \"\"" Sep 08 07:06:06.786724 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.786692 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" Sep 08 07:06:06.787167 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.786690 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh" event={"ID":"035d5e44-da6b-4170-8684-ef7f65ec483e","Type":"ContainerDied","Data":"180a51c2faddf6aad459e850009e00c6859eb6502c69ce147815b4da70b25aad"} Sep 08 07:06:06.787167 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.786856 2547 scope.go:117] "RemoveContainer" containerID="fc4cc7bf66e5e38b2261933dd15296f64efa5fa5332bae11cf9efce763020d8a" Sep 08 07:06:06.795791 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.795771 2547 scope.go:117] "RemoveContainer" containerID="506f09705bfba88302235d5dda213a765f0efc20c13b7fd30e78d9d8af3c0861" Sep 08 07:06:06.809516 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.809490 2547 scope.go:117] "RemoveContainer" containerID="609a3a4cc7cd3bf2031d8796093afcf49613b2d7d7cdd78e010f859acf0b9208" Sep 08 07:06:06.816851 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.816821 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:06:06.819548 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.819529 2547 scope.go:117] "RemoveContainer" containerID="c96718bd80d00311f74bdd9795537d015e4be9298b60c8646d3cfce5be466db3" Sep 08 07:06:06.827833 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.827813 2547 scope.go:117] "RemoveContainer" containerID="7bf2f26aeb7ee5ae76298a88c4c8c5bf26c183b150191c3fc192bda92913421b" Sep 08 07:06:06.838132 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.838103 2547 scope.go:117] "RemoveContainer" containerID="06f737f91225b420f54ae324176c8a8a9e4ad67e6c74107ac0bd489ee779d250" Sep 08 07:06:06.854149 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:06.854121 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gvqmh"] Sep 08 07:06:07.687626 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:07.687587 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" path="/var/lib/kubelet/pods/035d5e44-da6b-4170-8684-ef7f65ec483e/volumes" Sep 08 07:06:07.688255 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:07.688239 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c606204-20d2-4eb8-8758-24f63545faba" path="/var/lib/kubelet/pods/1c606204-20d2-4eb8-8758-24f63545faba/volumes" Sep 08 07:06:42.340563 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340527 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnk5h/must-gather-t2zsj"] Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340836 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="feast-init" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340848 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="feast-init" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340855 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340861 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340870 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340876 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340890 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="feast-apply" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340896 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="feast-apply" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340903 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340908 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340918 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="feast-init" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340923 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="feast-init" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340929 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340934 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340940 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340945 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340951 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340956 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340962 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340967 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340973 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="feast-apply" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.340978 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="feast-apply" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341027 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341034 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="ui" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341041 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341048 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="offline" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341053 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="online" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341058 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="035d5e44-da6b-4170-8684-ef7f65ec483e" containerName="registry" Sep 08 07:06:42.341082 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.341065 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c606204-20d2-4eb8-8758-24f63545faba" containerName="ui" Sep 08 07:06:42.344125 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.344106 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.346440 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.346410 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fnk5h\"/\"default-dockercfg-ghdj6\"" Sep 08 07:06:42.346440 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.346412 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnk5h\"/\"kube-root-ca.crt\"" Sep 08 07:06:42.346612 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.346538 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnk5h\"/\"openshift-service-ca.crt\"" Sep 08 07:06:42.352829 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.352807 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/must-gather-t2zsj"] Sep 08 07:06:42.403122 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.403091 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6gq\" (UniqueName: \"kubernetes.io/projected/c0590698-ecd5-4c6b-94f8-0b9d44f51609-kube-api-access-tg6gq\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.403264 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.403126 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0590698-ecd5-4c6b-94f8-0b9d44f51609-must-gather-output\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.504244 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.504207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6gq\" (UniqueName: \"kubernetes.io/projected/c0590698-ecd5-4c6b-94f8-0b9d44f51609-kube-api-access-tg6gq\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.504421 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.504254 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0590698-ecd5-4c6b-94f8-0b9d44f51609-must-gather-output\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.504658 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.504635 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0590698-ecd5-4c6b-94f8-0b9d44f51609-must-gather-output\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.512489 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.512457 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6gq\" (UniqueName: \"kubernetes.io/projected/c0590698-ecd5-4c6b-94f8-0b9d44f51609-kube-api-access-tg6gq\") pod \"must-gather-t2zsj\" (UID: \"c0590698-ecd5-4c6b-94f8-0b9d44f51609\") " pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.661348 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.661254 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" Sep 08 07:06:42.930351 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.930325 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/must-gather-t2zsj"] Sep 08 07:06:42.932846 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:06:42.932816 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0590698_ecd5_4c6b_94f8_0b9d44f51609.slice/crio-221d698d9a7dd417ca1181c20715fa89ff24ecf924a268b76848c4f6ec94f22e WatchSource:0}: Error finding container 221d698d9a7dd417ca1181c20715fa89ff24ecf924a268b76848c4f6ec94f22e: Status 404 returned error can't find the container with id 221d698d9a7dd417ca1181c20715fa89ff24ecf924a268b76848c4f6ec94f22e Sep 08 07:06:42.934586 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:42.934570 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 07:06:43.941466 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:43.941366 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" event={"ID":"c0590698-ecd5-4c6b-94f8-0b9d44f51609","Type":"ContainerStarted","Data":"95ba6f2f16acd1ffae9ac2b5919b52fc2a59f01e883c838b06cf5d17a9da44ac"} Sep 08 07:06:43.941466 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:43.941413 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" event={"ID":"c0590698-ecd5-4c6b-94f8-0b9d44f51609","Type":"ContainerStarted","Data":"f7506bfe528cc88c9cd183fddbcb5da087515c59f7e99300932404b03ff2faea"} Sep 08 07:06:43.941466 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:43.941429 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" event={"ID":"c0590698-ecd5-4c6b-94f8-0b9d44f51609","Type":"ContainerStarted","Data":"221d698d9a7dd417ca1181c20715fa89ff24ecf924a268b76848c4f6ec94f22e"} Sep 08 07:06:43.962960 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:43.962892 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnk5h/must-gather-t2zsj" podStartSLOduration=1.281681446 podStartE2EDuration="1.962870329s" totalImagesPullingTime="681.188883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:06:43.96042337 +0000 UTC m=+1916.769531951" watchObservedRunningTime="2026-09-08 07:06:43.962870329 +0000 UTC m=+1916.771978909" Sep 08 07:06:44.930631 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:44.930599 2547 ???:1] "http: TLS handshake error from 10.0.135.120:46368: EOF" Sep 08 07:06:44.934545 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:44.934513 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fx7b4_a23c0b0c-4502-432b-90e9-47b49c6fd9b2/global-pull-secret-syncer/0.log" Sep 08 07:06:45.064477 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:45.064446 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vj5sv_774f36e1-bcfc-47fd-a383-86d332d68292/konnectivity-agent/0.log" Sep 08 07:06:45.141290 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:45.141266 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-183.ec2.internal_1c749b6c2a01b1fce303e8fb7539e8c0/haproxy/0.log" Sep 08 07:06:48.650561 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.650503 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/alertmanager/0.log" Sep 08 07:06:48.684355 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.684329 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/config-reloader/0.log" Sep 08 07:06:48.712615 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.712550 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/kube-rbac-proxy-web/0.log" Sep 08 07:06:48.743618 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.743558 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/kube-rbac-proxy/0.log" Sep 08 07:06:48.773065 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.772927 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/kube-rbac-proxy-metric/0.log" Sep 08 07:06:48.800269 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.800229 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/prom-label-proxy/0.log" Sep 08 07:06:48.833127 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.833092 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02694bdf-94ba-43e6-b491-62b5039c8d9e/init-config-reloader/0.log" Sep 08 07:06:48.998739 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:48.998565 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7666cc5668-cd5q7_e1a6120e-7c8e-442f-9db6-0d90b69185c9/metrics-server/0.log" Sep 08 07:06:49.346666 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.346600 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5m4r_0db4edc9-94b7-4ccc-a97d-17912cfa8e8e/node-exporter/0.log" Sep 08 07:06:49.413999 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.413971 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5m4r_0db4edc9-94b7-4ccc-a97d-17912cfa8e8e/kube-rbac-proxy/0.log" Sep 08 07:06:49.474780 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.474749 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5m4r_0db4edc9-94b7-4ccc-a97d-17912cfa8e8e/init-textfile/0.log" Sep 08 07:06:49.537264 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.537204 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7tx4b_36fa3f65-cada-4664-b6c2-4bead1a5472b/kube-rbac-proxy-main/0.log" Sep 08 07:06:49.613547 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.613454 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7tx4b_36fa3f65-cada-4664-b6c2-4bead1a5472b/kube-rbac-proxy-self/0.log" Sep 08 07:06:49.674145 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.674114 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7tx4b_36fa3f65-cada-4664-b6c2-4bead1a5472b/openshift-state-metrics/0.log" Sep 08 07:06:49.972658 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.972574 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655c7f7fb9-2ssgz_4273c74d-90bb-4c0c-81e9-c5d2143bb7e4/telemeter-client/0.log" Sep 08 07:06:49.995342 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:49.995303 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655c7f7fb9-2ssgz_4273c74d-90bb-4c0c-81e9-c5d2143bb7e4/reload/0.log" Sep 08 07:06:50.018203 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:50.018173 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655c7f7fb9-2ssgz_4273c74d-90bb-4c0c-81e9-c5d2143bb7e4/kube-rbac-proxy/0.log" Sep 08 07:06:51.885084 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:51.885014 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/1.log" Sep 08 07:06:51.893691 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:51.893656 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-vgqkd_bfde7c97-51ad-4149-a800-12d32ea22d84/console-operator/2.log" Sep 08 07:06:52.251580 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.251478 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb"] Sep 08 07:06:52.257442 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.257409 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.273703 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.272244 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb"] Sep 08 07:06:52.334005 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.333974 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845f77959b-fpv8t_71718b8a-85c7-49cb-bdc4-e081c87a8042/console/0.log" Sep 08 07:06:52.366514 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.366480 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-h6z48_f145e1de-ffc8-46de-ae56-02cb59bf59cb/download-server/0.log" Sep 08 07:06:52.401227 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.401180 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-sys\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.401434 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.401239 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-podres\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.401434 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.401342 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-proc\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.401556 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.401435 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gpgw\" (UniqueName: \"kubernetes.io/projected/b24f66ae-8e53-4bc9-b57f-79086ddab80b-kube-api-access-2gpgw\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.401556 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.401538 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-lib-modules\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502446 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502350 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-lib-modules\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502446 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502410 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-sys\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502530 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-podres\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502582 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-lib-modules\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502610 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-proc\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502629 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-sys\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502667 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gpgw\" (UniqueName: \"kubernetes.io/projected/b24f66ae-8e53-4bc9-b57f-79086ddab80b-kube-api-access-2gpgw\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.502692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502691 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-podres\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.503002 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.502836 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b24f66ae-8e53-4bc9-b57f-79086ddab80b-proc\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.511430 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.511394 2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gpgw\" (UniqueName: \"kubernetes.io/projected/b24f66ae-8e53-4bc9-b57f-79086ddab80b-kube-api-access-2gpgw\") pod \"perf-node-gather-daemonset-d7lfb\" (UID: \"b24f66ae-8e53-4bc9-b57f-79086ddab80b\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.575434 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.575388 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:52.862841 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.862339 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb"] Sep 08 07:06:52.866201 ip-10-0-132-183 kubenswrapper[2547]: W0908 07:06:52.865468 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb24f66ae_8e53_4bc9_b57f_79086ddab80b.slice/crio-7bbe43a961df2c9dd1c9161e2851825c8210954769c4b557a9999e6f0feab55a WatchSource:0}: Error finding container 7bbe43a961df2c9dd1c9161e2851825c8210954769c4b557a9999e6f0feab55a: Status 404 returned error can't find the container with id 7bbe43a961df2c9dd1c9161e2851825c8210954769c4b557a9999e6f0feab55a Sep 08 07:06:52.992115 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:52.992070 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" event={"ID":"b24f66ae-8e53-4bc9-b57f-79086ddab80b","Type":"ContainerStarted","Data":"7bbe43a961df2c9dd1c9161e2851825c8210954769c4b557a9999e6f0feab55a"} Sep 08 07:06:53.632126 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:53.632096 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ht62t_d088f935-aa9c-4f71-a655-a17741bc90aa/dns/0.log" Sep 08 07:06:53.653117 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:53.653084 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ht62t_d088f935-aa9c-4f71-a655-a17741bc90aa/kube-rbac-proxy/0.log" Sep 08 07:06:53.804831 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:53.804797 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vct6x_6b861c3d-3342-4009-ae7c-ec909768e808/dns-node-resolver/0.log" Sep 08 07:06:53.999512 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:53.999417 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" event={"ID":"b24f66ae-8e53-4bc9-b57f-79086ddab80b","Type":"ContainerStarted","Data":"e4fe1139f5d7301d03e0eb861f261d11ed6293f490e752fd97f50ccbce04b3ad"} Sep 08 07:06:53.999925 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:53.999523 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:06:54.016473 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:54.016404 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" podStartSLOduration=2.016362218 podStartE2EDuration="2.016362218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:06:54.015938708 +0000 UTC m=+1926.825047289" watchObservedRunningTime="2026-09-08 07:06:54.016362218 +0000 UTC m=+1926.825470798" Sep 08 07:06:54.186936 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:54.186907 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bdff6d449-z6k6z_262c0e6c-c940-497c-b5b4-803a0c37afac/registry/0.log" Sep 08 07:06:54.251678 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:54.251582 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv46b_e9411fc0-ebff-49fc-8121-b0a986212212/node-ca/0.log" Sep 08 07:06:54.927425 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:54.927390 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ccd684956-xcbxb_116cf422-4f03-420b-8080-27e0313c0a2f/router/0.log" Sep 08 07:06:55.270532 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:55.270441 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hswq2_dd6cfa9a-5237-4b6c-bd3f-b673074428ae/serve-healthcheck-canary/0.log" Sep 08 07:06:55.618118 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:55.618080 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77plq_6bd49282-0656-4f25-9f76-0405f523131c/kube-rbac-proxy/0.log" Sep 08 07:06:55.640249 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:55.640218 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77plq_6bd49282-0656-4f25-9f76-0405f523131c/exporter/0.log" Sep 08 07:06:55.661346 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:55.661316 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77plq_6bd49282-0656-4f25-9f76-0405f523131c/extractor/0.log" Sep 08 07:06:59.836544 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:59.836515 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q5xds_92a51117-e9ca-4e1c-83ad-aae082a7a561/migrator/0.log" Sep 08 07:06:59.863972 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:06:59.863941 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-q5xds_92a51117-e9ca-4e1c-83ad-aae082a7a561/graceful-termination/0.log" Sep 08 07:07:00.014369 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:00.014336 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-d7lfb" Sep 08 07:07:01.374407 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.374328 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/kube-multus-additional-cni-plugins/0.log" Sep 08 07:07:01.398873 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.398768 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/egress-router-binary-copy/0.log" Sep 08 07:07:01.429348 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.429298 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/cni-plugins/0.log" Sep 08 07:07:01.455945 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.455786 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/bond-cni-plugin/0.log" Sep 08 07:07:01.482071 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.482041 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/routeoverride-cni/0.log" Sep 08 07:07:01.505281 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.505249 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/whereabouts-cni-bincopy/0.log" Sep 08 07:07:01.528253 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.528214 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hx5ks_bcfae9c3-bc3a-4d4e-9b3c-b2383ed6d8d1/whereabouts-cni/0.log" Sep 08 07:07:01.834267 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.834234 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhsr2_328b049c-7a58-48a1-b835-472bf306f6b8/kube-multus/0.log" Sep 08 07:07:01.924353 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.924279 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vfqp2_cfb4d491-ae35-479a-85df-e41f06cc209b/network-metrics-daemon/0.log" Sep 08 07:07:01.949175 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:01.949131 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vfqp2_cfb4d491-ae35-479a-85df-e41f06cc209b/kube-rbac-proxy/0.log" Sep 08 07:07:02.687444 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.687393 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/ovn-controller/0.log" Sep 08 07:07:02.706170 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.706143 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/ovn-acl-logging/0.log" Sep 08 07:07:02.729629 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.729596 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/kube-rbac-proxy-node/0.log" Sep 08 07:07:02.753946 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.753917 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 07:07:02.775912 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.775875 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/northd/0.log" Sep 08 07:07:02.796692 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.796658 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/nbdb/0.log" Sep 08 07:07:02.817842 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.817810 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/sbdb/0.log" Sep 08 07:07:02.866915 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:02.866869 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2zbx9_de37eb23-d595-4a79-8a43-5ebe7b6dd062/ovnkube-controller/0.log" Sep 08 07:07:04.239828 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:04.239794 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-r4pjv_3a1076f8-b2a3-46f0-b49a-3854a83cd29a/network-check-target-container/0.log" Sep 08 07:07:05.166219 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:05.166192 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5bbqf_8b5a0a08-bad3-43d2-a7df-28cca89688b7/iptables-alerter/0.log" Sep 08 07:07:05.950458 ip-10-0-132-183 kubenswrapper[2547]: I0908 07:07:05.950431 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2n9tm_e6c7a368-f33a-49c7-a8b0-faa625a90a51/tuned/0.log"