Jul 22 17:14:54.316590 ip-10-0-134-17 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 17:14:54.316600 ip-10-0-134-17 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 17:14:54.316607 ip-10-0-134-17 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 17:14:54.316846 ip-10-0-134-17 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 17:15:04.414248 ip-10-0-134-17 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 22 17:15:04.414263 ip-10-0-134-17 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 70c6f5e9ada642be9fd876fb598f39a1 -- Jul 22 17:16:59.862196 ip-10-0-134-17 systemd[1]: Starting Kubernetes Kubelet... Jul 22 17:17:00.353037 ip-10-0-134-17 systemd[1]: Started Kubernetes Kubelet. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.275276 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284107 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284121 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284125 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284128 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284132 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284135 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284138 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.354624 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284140 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284143 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284145 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284148 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284153 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284158 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284162 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284165 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284168 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284171 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284175 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284178 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284181 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284183 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284186 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284189 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284192 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284194 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284198 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.362010 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284200 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284204 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284207 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284209 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284211 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284214 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284216 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284219 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284222 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284224 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284227 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284229 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284232 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284235 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284237 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284240 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284242 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284244 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284247 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284249 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.362610 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284252 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284254 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284257 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284260 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284264 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284267 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284270 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284272 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284275 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284277 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284280 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284282 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284285 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284288 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284291 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284293 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284296 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284299 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284301 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284304 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.363503 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284307 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284310 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284313 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284316 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284319 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284321 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284323 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284326 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284328 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284331 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284334 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284336 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284339 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284342 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284346 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284350 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284353 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284357 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284360 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.364147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284363 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284365 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284368 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284370 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284373 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284376 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284379 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284382 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284385 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284388 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284390 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284393 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284395 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.284398 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285144 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285151 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285155 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285157 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285160 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285163 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.364730 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285166 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285168 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285171 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285173 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285176 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285179 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285182 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285184 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285187 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285189 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285192 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285195 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285198 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285200 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285203 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285205 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285208 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285211 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285214 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.365791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285218 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285222 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285225 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285228 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285231 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285234 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285237 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285239 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285242 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285244 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285247 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285250 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285253 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285255 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285258 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285261 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285263 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285266 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285269 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285272 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.366440 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285274 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285277 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285279 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285282 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285285 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285288 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285290 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285293 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285295 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285298 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285301 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285303 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285306 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285308 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285311 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285315 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285317 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285320 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285322 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285325 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.367303 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285327 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285330 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285332 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285335 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285337 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285340 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285342 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285345 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285352 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285356 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285359 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285362 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285365 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285367 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285370 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285374 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285379 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285382 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285388 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.368172 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285391 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285394 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285396 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285399 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285402 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285404 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285407 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285410 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285412 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285415 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285417 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285420 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285423 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285425 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285428 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285799 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285804 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285807 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285811 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285815 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.369909 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285818 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285823 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285826 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285828 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285831 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285834 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285836 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285839 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285841 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285844 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285847 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285851 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285854 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285857 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285859 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285862 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285864 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285867 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285869 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285872 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.370739 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285875 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285877 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285880 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285882 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285885 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285887 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285890 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285892 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285895 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285898 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285900 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285903 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285905 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285909 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285911 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285914 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285916 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285934 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285937 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.371802 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285940 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285942 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285945 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285954 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285959 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285963 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285965 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285968 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285971 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285973 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285976 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285979 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285981 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285983 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285986 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285988 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285991 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285994 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285996 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.372853 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.285999 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286001 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286004 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286007 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286010 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286013 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286016 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286019 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286022 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286024 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286027 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286031 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286034 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286037 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286040 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286043 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286046 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286050 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286053 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286056 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.373499 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286059 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286062 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286065 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286067 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286070 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286072 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286074 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286077 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286080 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286082 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286085 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286087 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286090 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286092 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286095 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286097 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286171 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286182 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286191 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286200 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286206 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286211 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 17:17:00.374142 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286216 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286222 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286225 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286228 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286231 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286234 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286237 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286242 2582 flags.go:64] FLAG: --cgroup-root="" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286245 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286248 2582 flags.go:64] FLAG: --client-ca-file="" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286252 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286255 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286259 2582 flags.go:64] FLAG: --cluster-domain="" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286262 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286265 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286268 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286271 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286275 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286277 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286281 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286284 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286287 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286290 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286293 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 17:17:00.375180 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286296 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286299 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286303 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286306 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286309 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286313 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286316 2582 flags.go:64] FLAG: --enable-server="true" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286319 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286323 2582 flags.go:64] FLAG: --event-burst="100" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286327 2582 flags.go:64] FLAG: --event-qps="50" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286329 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286332 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286335 2582 flags.go:64] FLAG: --eviction-hard="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286339 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286342 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286347 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286350 2582 flags.go:64] FLAG: --eviction-soft="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286352 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286355 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286359 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286362 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286364 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286367 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286370 2582 flags.go:64] FLAG: --feature-gates="" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286373 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 17:17:00.376204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286376 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286379 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286382 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286394 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286398 2582 flags.go:64] FLAG: --help="false" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286401 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286404 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286407 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286410 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286413 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286417 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286420 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286424 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286426 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286429 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286432 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286435 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286438 2582 flags.go:64] FLAG: --kube-reserved="" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286441 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286444 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286447 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286450 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286454 2582 flags.go:64] FLAG: --lock-file="" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286457 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 17:17:00.377044 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286460 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286463 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286468 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286489 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286493 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286496 2582 flags.go:64] FLAG: --logging-format="text" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286499 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286503 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286506 2582 flags.go:64] FLAG: --manifest-url="" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286508 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286512 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286515 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286519 2582 flags.go:64] FLAG: --max-pods="110" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286522 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286525 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286528 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286530 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286533 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286536 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286539 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286548 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286551 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286553 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 17:17:00.377990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286556 2582 flags.go:64] FLAG: --pod-cidr="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286559 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286564 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286567 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286570 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286573 2582 flags.go:64] FLAG: --port="10250" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286576 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286583 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05fbebd128c3d5c8a" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286586 2582 flags.go:64] FLAG: --qos-reserved="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286588 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286592 2582 flags.go:64] FLAG: --register-node="true" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286594 2582 flags.go:64] FLAG: --register-with-taints="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286598 2582 flags.go:64] FLAG: --registry-burst="10" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286601 2582 flags.go:64] FLAG: --registry-qps="5" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286604 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286607 2582 flags.go:64] FLAG: --reserved-memory="" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286610 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286613 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286616 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286619 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286622 2582 flags.go:64] FLAG: --runonce="false" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286625 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286628 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286630 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286633 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 17:17:00.510213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286636 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286639 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286642 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286644 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286647 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286652 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286655 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286658 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286661 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286664 2582 flags.go:64] FLAG: --system-cgroups="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286666 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286671 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286674 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286677 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286682 2582 flags.go:64] FLAG: --tls-min-version="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286685 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286688 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286691 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286694 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286696 2582 flags.go:64] FLAG: --v="2" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286700 2582 flags.go:64] FLAG: --version="false" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286709 2582 flags.go:64] FLAG: --vmodule="" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286712 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.286716 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286833 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.536411 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286837 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286841 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286844 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286847 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286850 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286852 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286855 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286857 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286860 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286863 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286865 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286868 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286872 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286875 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286878 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286880 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286883 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286886 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286888 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.537495 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286891 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286893 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286897 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286900 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286902 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286905 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286907 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286910 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286912 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286915 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286918 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286934 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286937 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286940 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286943 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286945 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286948 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286951 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286953 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.539147 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286956 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286958 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286961 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286965 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286969 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286972 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286976 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286978 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286981 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286983 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286986 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286989 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286993 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.286996 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287000 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287003 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287006 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287009 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287012 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287015 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.539824 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287017 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287020 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287022 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287025 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287028 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287031 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287033 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287036 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287038 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287041 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287044 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287046 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287049 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287051 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287054 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287056 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287058 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287061 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287065 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287067 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.540517 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287070 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287073 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287075 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287078 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287081 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287083 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287086 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287091 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287094 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287098 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287100 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287103 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287106 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287109 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287112 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287115 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287117 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287120 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287123 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.541336 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.287126 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.287855 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294180 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294195 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294215 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294221 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294274 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294278 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294282 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294286 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294289 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294292 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294295 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294298 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294301 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.542056 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294304 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294307 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294310 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294313 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294316 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294318 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294321 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294323 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294326 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294329 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294332 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294335 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294338 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294340 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294345 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294348 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294351 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294354 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294356 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.542608 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294359 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294362 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294365 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294369 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294373 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294376 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294378 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294381 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294391 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294397 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294400 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294403 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294406 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294408 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294411 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294414 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294416 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294419 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294422 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.652735 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294424 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294427 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294430 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294432 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294435 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294437 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294440 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294442 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294447 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294451 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294454 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294456 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294459 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294462 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294464 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294469 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294472 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294475 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294477 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294480 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.653704 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294482 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294485 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294487 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294489 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294492 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294494 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294497 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294500 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294502 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294505 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294507 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294510 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294513 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294515 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294518 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294520 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294523 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294525 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294528 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294530 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.654360 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294534 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294537 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294539 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294542 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294544 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294547 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294549 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294552 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294561 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294564 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294566 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294569 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294574 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294698 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294703 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 17:17:00.655030 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294706 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294709 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294712 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294715 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294717 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294720 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294723 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294726 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294729 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294733 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294735 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294738 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294741 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294744 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294748 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294750 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294753 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294756 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294759 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 17:17:00.655679 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294761 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294765 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294769 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294772 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294774 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294777 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294780 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294784 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294787 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294790 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294792 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294795 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294798 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294801 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294804 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294806 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294809 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294811 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294814 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 17:17:00.656347 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294816 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294819 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294821 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294826 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294829 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294833 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294836 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294838 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294841 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294844 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294847 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294850 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294853 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294856 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294859 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294862 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294865 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294868 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294870 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294873 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 17:17:00.656922 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294875 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294878 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294881 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294883 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294886 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294888 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294891 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294893 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294896 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294898 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294901 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294903 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294906 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294908 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294911 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294916 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294933 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294937 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294940 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294942 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 17:17:00.657583 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294945 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294947 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294950 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294955 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294958 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294960 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294963 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294966 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294968 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294971 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294973 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294976 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294978 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294981 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294984 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294986 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294989 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294991 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 17:17:00.658201 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:00.294994 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.294999 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.295097 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.297853 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.299224 2582 server.go:1019] "Starting client certificate rotation" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.299326 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.299364 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.302165 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.303627 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.318393 2582 log.go:25] "Validated CRI v1 runtime API" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.320293 2582 log.go:25] "Validated CRI v1 image API" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.321065 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 17:17:00.658779 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.323586 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8f6b5a98-8b8e-4908-a2a8-20e18760a199:/dev/nvme0n1p3 9bdf5640-0ec6-43da-bd04-97c21485deb4:/dev/nvme0n1p4] Jul 22 17:17:00.659187 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.323599 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 17:17:00.659187 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.327110 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.328499 2582 manager.go:216] Machine: {Timestamp:2026-07-22 17:17:00.327290243 +0000 UTC m=+0.343635461 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096731 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad0454cc168a00182400172c2bc18 SystemUUID:ec2ad045-4cc1-68a0-0182-400172c2bc18 BootID:70c6f5e9-ada6-42be-9fd8-76fb598f39a1 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:ae:20:ca:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:ae:20:ca:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:47:7e:2d:0d:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.328598 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.328675 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.331450 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.331478 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.332228 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.332238 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.332245 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.332882 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.334022 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.337833 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.337955 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338535 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338548 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338566 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338576 2582 kubelet.go:398] "Adding apiserver pod source" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338584 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 17:17:00.659380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338875 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.338894 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.342208 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.344062 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.344089 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345175 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345190 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345197 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345203 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345216 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345225 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345234 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345239 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345247 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345252 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345271 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.345277 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.346251 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.346258 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.349035 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.349388 2582 server.go:1268] "Started kubelet" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.349442 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.349509 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.352294 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.354065 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.354943 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.355099 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.357416 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zn65" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.357850 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.358228 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.364423 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.364753 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.365583 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.365621 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.366153 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.366168 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.366292 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.366298 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368185 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2zn65" Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368377 2582 factory.go:55] Registering systemd factory Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368394 2582 factory.go:223] Registration of the systemd container factory successfully Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368597 2582 factory.go:153] Registering CRI-O factory Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368744 2582 factory.go:223] Registration of the crio container factory successfully Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368807 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368832 2582 factory.go:103] Registering Raw factory Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.368856 2582 manager.go:1196] Started watching for new ooms in manager Jul 22 17:17:00.660199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.369287 2582 manager.go:349] Starting recovery of all containers Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.368327 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-17.ec2.internal.18c4ac23641f10f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-17.ec2.internal,UID:ip-10-0-134-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-17.ec2.internal,},FirstTimestamp:2026-07-22 17:17:00.34914943 +0000 UTC m=+0.365494648,LastTimestamp:2026-07-22 17:17:00.34914943 +0000 UTC m=+0.365494648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-17.ec2.internal,}" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.385236 2582 manager.go:354] Recovery completed Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.386645 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.389358 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.391383 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.391418 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.391435 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.391631 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-17.ec2.internal\" not found" node="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.392274 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.392286 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.392307 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.392279 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393144 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393177 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393194 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393450 2582 policy_none.go:49] "None policy: Start" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393463 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.393473 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.394442 2582 policy_none.go:47] "Start" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430499 2582 manager.go:337] "Starting Device Plugin manager" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.430527 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430536 2582 server.go:87] "Starting device plugin registration server" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430758 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430767 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430847 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430942 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.430951 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.431432 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.431473 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.531525 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.532551 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.532576 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.532587 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.532614 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.541726 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.541744 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-17.ec2.internal\": node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.547906 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.549085 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.549115 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.549133 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.549162 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 17:17:00.661947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.553488 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.557494 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.655254 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal"] Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.655351 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.657017 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.657049 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.657064 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.658037 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.659336 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.659461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.659489 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660151 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660159 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660174 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660177 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660186 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.660189 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.662509 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.662539 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.663227 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientMemory" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.663257 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 17:17:00.663370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.663272 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeHasSufficientPID" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.666927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.666956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38d375f9e4eff9d7cd26e8a8abd987f9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"38d375f9e4eff9d7cd26e8a8abd987f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.666975 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.688536 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-17.ec2.internal\" not found" node="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.697652 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-17.ec2.internal\" not found" node="ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.758164 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38d375f9e4eff9d7cd26e8a8abd987f9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"38d375f9e4eff9d7cd26e8a8abd987f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767952 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/38d375f9e4eff9d7cd26e8a8abd987f9-config\") pod \"kube-apiserver-proxy-ip-10-0-134-17.ec2.internal\" (UID: \"38d375f9e4eff9d7cd26e8a8abd987f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.810537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.767971 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dbc543c56d8a4baafed4a2baef66d45-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal\" (UID: \"1dbc543c56d8a4baafed4a2baef66d45\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:00.969790 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.858631 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:00.969790 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:00.960594 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.145788 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:00.991875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:01.145788 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.001161 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:01.145788 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.061507 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.311540 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.162381 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.311540 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.263474 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.311540 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.298966 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 17:17:01.311540 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.299104 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 17:17:01.311540 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.299149 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 17:17:01.444896 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.363839 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.444896 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.372233 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 17:12:01 +0000 UTC" deadline="2028-02-16 01:28:56.839882516 +0000 UTC" Jul 22 17:17:01.444896 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.372256 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13760h11m55.4676298s" Jul 22 17:17:01.585295 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.464122 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.585295 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.565217 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.670978 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.666277 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.760385 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:01.731507 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbc543c56d8a4baafed4a2baef66d45.slice/crio-96213ffd7c012f137dd1497fcbbd69c821fbd4652a9749de04b39869e75af8da WatchSource:0}: Error finding container 96213ffd7c012f137dd1497fcbbd69c821fbd4652a9749de04b39869e75af8da: Status 404 returned error can't find the container with id 96213ffd7c012f137dd1497fcbbd69c821fbd4652a9749de04b39869e75af8da Jul 22 17:17:01.760385 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:01.731741 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d375f9e4eff9d7cd26e8a8abd987f9.slice/crio-5d412f4ba7983b8e8da1fed1342c0115a365af38aaf02f28b178fc9d98c45f5b WatchSource:0}: Error finding container 5d412f4ba7983b8e8da1fed1342c0115a365af38aaf02f28b178fc9d98c45f5b: Status 404 returned error can't find the container with id 5d412f4ba7983b8e8da1fed1342c0115a365af38aaf02f28b178fc9d98c45f5b Jul 22 17:17:01.760385 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.736109 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:17:01.907296 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.766324 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.907296 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:01.866546 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-17.ec2.internal\" not found" Jul 22 17:17:01.907296 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.897173 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:01.925534 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.925516 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:01.966840 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.966805 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" Jul 22 17:17:01.978933 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.978906 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 17:17:01.980022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.980008 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" Jul 22 17:17:01.992291 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:01.992272 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 17:17:02.342653 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.342347 2582 apiserver.go:52] "Watching apiserver" Jul 22 17:17:02.348061 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.347856 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 17:17:02.348420 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.348391 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-wf9ml","openshift-multus/multus-additional-cni-plugins-gf4tx","openshift-ovn-kubernetes/ovnkube-node-vcp5l","kube-system/global-pull-secret-syncer-tcq4h","openshift-cluster-node-tuning-operator/tuned-5zcdz","openshift-image-registry/node-ca-8s52n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal","openshift-multus/multus-29qvb","openshift-multus/network-metrics-daemon-rvfvp","openshift-network-diagnostics/network-check-target-sr8m6","openshift-network-operator/iptables-alerter-qnf82","kube-system/konnectivity-agent-vwndh","kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn"] Jul 22 17:17:02.351426 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.351400 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:02.351566 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.351486 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:02.354248 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.354223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.357025 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.356960 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.357216 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.357188 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 17:17:02.357324 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.357256 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdsqq\"" Jul 22 17:17:02.357791 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.357749 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.359205 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.359005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.360960 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.360931 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 17:17:02.361799 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.361775 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 17:17:02.362072 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.362053 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.362155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.362073 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g2lhx\"" Jul 22 17:17:02.362343 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.362323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.362472 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.362449 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:02.362631 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.362609 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 17:17:02.363881 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.363811 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:02.364234 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.364214 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.364498 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.364478 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 17:17:02.365601 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.365579 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 17:17:02.368281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.367804 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.371775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.370502 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ptrm2\"" Jul 22 17:17:02.371775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.370814 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.371775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.371124 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.371775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.371370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.374292 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.374272 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.374492 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.374363 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:02.374702 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.374683 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 17:17:02.375547 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.374751 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.375825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.375051 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.375825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.375117 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lmph6\"" Jul 22 17:17:02.376669 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.376652 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.377710 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-log-socket\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.377800 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-tmp\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.377800 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e899166-40ce-4fd8-9d09-3c945a004277-iptables-alerter-script\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.377800 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-systemd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.377800 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377788 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-config\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377838 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-env-overrides\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-script-lib\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgwc6\" (UniqueName: \"kubernetes.io/projected/a3003f4c-5727-487b-a5a8-960a88011272-kube-api-access-cgwc6\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-run\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-slash\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3003f4c-5727-487b-a5a8-960a88011272-ovn-node-metrics-cert\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.377987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-host\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-kubelet-config\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-modprobe-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-conf\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-etc-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-ovn\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-dbus\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-tuned\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzx45\" (UniqueName: \"kubernetes.io/projected/2e899166-40ce-4fd8-9d09-3c945a004277-kube-api-access-gzx45\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-kubelet\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.378462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-netns\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-bin\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378543 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-netd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysconfig\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-systemd\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378617 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-lib-modules\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/465ab9d1-327f-41fb-ac50-975f7d37ab23-serviceca\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pklhf\" (UniqueName: \"kubernetes.io/projected/465ab9d1-327f-41fb-ac50-975f7d37ab23-kube-api-access-pklhf\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-systemd-units\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-var-lib-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-sys\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-kubernetes\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378794 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-var-lib-kubelet\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjgl\" (UniqueName: \"kubernetes.io/projected/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-kube-api-access-pqjgl\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378844 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/465ab9d1-327f-41fb-ac50-975f7d37ab23-host\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.379140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e899166-40ce-4fd8-9d09-3c945a004277-host-slash\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.378938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-node-log\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.379437 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.379658 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.379669 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72z66\"" Jul 22 17:17:02.379918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.379833 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.380592 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.380556 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 17:17:02.381457 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.381435 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.383710 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.383177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 17:17:02.383710 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.383491 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.383838 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.383726 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gq8md\"" Jul 22 17:17:02.383838 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.383784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 17:17:02.384035 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.383980 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.384370 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.384350 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 17:17:02.385872 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.385416 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.387511 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.387488 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 17:17:02.387712 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.387698 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 17:17:02.388394 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.388188 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p7x94\"" Jul 22 17:17:02.389625 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.388638 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.390605 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.390586 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 17:17:02.390710 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.390689 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qth4\"" Jul 22 17:17:02.391350 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.391327 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.393101 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.393060 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 17:17:02.393506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.393487 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9cfcg\"" Jul 22 17:17:02.393967 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.393766 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 17:17:02.398745 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.398712 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m6l2r" Jul 22 17:17:02.405422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.405248 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m6l2r" Jul 22 17:17:02.466674 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.466643 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 17:17:02.479173 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.479307 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-bin\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479307 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5929ab95-84c7-49e8-99b9-5f795fdeb554-agent-certs\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.479307 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.479307 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4d76be-c869-4a60-8df1-0e96de9654ed-tmp-dir\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-systemd-units\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479354 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sslf\" (UniqueName: \"kubernetes.io/projected/b9de728b-83a2-464e-be35-04d26c6a8c60-kube-api-access-5sslf\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-conf-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479408 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-multus-certs\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479418 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pdh\" (UniqueName: \"kubernetes.io/projected/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-kube-api-access-c9pdh\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-kubelet\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.479520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479500 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-systemd-units\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-bin\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479582 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z7g8\" (UniqueName: \"kubernetes.io/projected/acbce321-0157-468d-8dbe-88e47ffb0a30-kube-api-access-5z7g8\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479627 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-var-lib-kubelet\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjgl\" (UniqueName: \"kubernetes.io/projected/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-kube-api-access-pqjgl\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/465ab9d1-327f-41fb-ac50-975f7d37ab23-host\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e899166-40ce-4fd8-9d09-3c945a004277-host-slash\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-node-log\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479822 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-log-socket\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-config\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479920 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e899166-40ce-4fd8-9d09-3c945a004277-iptables-alerter-script\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.479968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-env-overrides\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.479993 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e899166-40ce-4fd8-9d09-3c945a004277-host-slash\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-var-lib-kubelet\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.480110 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-bin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480195 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480250 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/465ab9d1-327f-41fb-ac50-975f7d37ab23-host\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.480638 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480288 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-config\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480707 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-env-overrides\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480726 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480793 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-log-socket\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480847 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-node-log\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.480913 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:02.980890613 +0000 UTC m=+2.997235828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.480959 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e899166-40ce-4fd8-9d09-3c945a004277-iptables-alerter-script\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-run\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3003f4c-5727-487b-a5a8-960a88011272-ovn-node-metrics-cert\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-host\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481154 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-kubelet-config\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-daemon-config\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5929ab95-84c7-49e8-99b9-5f795fdeb554-konnectivity-ca\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-modprobe-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-conf\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-ovn\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-hostroot\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-os-release\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481421 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481441 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-kubelet-config\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmtgx\" (UniqueName: \"kubernetes.io/projected/7b4d76be-c869-4a60-8df1-0e96de9654ed-kube-api-access-dmtgx\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-tuned\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481593 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-modprobe-d\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.481613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481606 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzx45\" (UniqueName: \"kubernetes.io/projected/2e899166-40ce-4fd8-9d09-3c945a004277-kube-api-access-gzx45\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-kubelet\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-netns\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481717 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysctl-conf\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-netd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481834 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-host\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481873 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-ovn\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysconfig\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481911 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-ovn-kubernetes\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481918 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-systemd\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-lib-modules\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/465ab9d1-327f-41fb-ac50-975f7d37ab23-serviceca\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482030 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-run\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pklhf\" (UniqueName: \"kubernetes.io/projected/465ab9d1-327f-41fb-ac50-975f7d37ab23-kube-api-access-pklhf\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.482475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.481798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-run-netns\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482112 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-sysconfig\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482161 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-systemd\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-var-lib-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-etc-kubernetes\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkbk\" (UniqueName: \"kubernetes.io/projected/ad7a40b5-78a3-444b-a990-59ac7847f109-kube-api-access-ttkbk\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-sys\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-os-release\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-multus\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482509 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-cnibin\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-kubernetes\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482614 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-kubernetes\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482614 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-var-lib-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-script-lib\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482677 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-sys\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482706 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482736 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-cni-netd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.483319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-device-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-tmp\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482845 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/465ab9d1-327f-41fb-ac50-975f7d37ab23-serviceca\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-systemd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgwc6\" (UniqueName: \"kubernetes.io/projected/a3003f4c-5727-487b-a5a8-960a88011272-kube-api-access-cgwc6\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482954 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482955 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-kubelet\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-system-cni-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.482922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-systemd\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483089 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-run-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-slash\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483465 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-k8s-cni-cncf-io\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-netns\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483517 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a3003f4c-5727-487b-a5a8-960a88011272-ovnkube-script-lib\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483592 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-host-slash\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.484207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b4d76be-c869-4a60-8df1-0e96de9654ed-hosts-file\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-etc-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-lib-modules\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-dbus\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483787 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42dbc1c-eaaf-44db-a51e-50877be12332-dbus\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483790 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a3003f4c-5727-487b-a5a8-960a88011272-etc-openvswitch\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-system-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cnibin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.483957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-socket-dir-parent\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.485054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.484052 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cni-binary-copy\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.485546 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.485524 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:02.485610 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.485555 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:02.485610 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.485570 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.485723 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.485666 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:02.985644414 +0000 UTC m=+3.001989640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.486954 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.486888 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a3003f4c-5727-487b-a5a8-960a88011272-ovn-node-metrics-cert\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.487146 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.487127 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-tmp\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.488062 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.488019 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-etc-tuned\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.491126 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.490775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjgl\" (UniqueName: \"kubernetes.io/projected/ba71b82b-a4c4-40f8-9c36-2dead93d7b0b-kube-api-access-pqjgl\") pod \"tuned-5zcdz\" (UID: \"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b\") " pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.493596 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.493565 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pklhf\" (UniqueName: \"kubernetes.io/projected/465ab9d1-327f-41fb-ac50-975f7d37ab23-kube-api-access-pklhf\") pod \"node-ca-8s52n\" (UID: \"465ab9d1-327f-41fb-ac50-975f7d37ab23\") " pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.496582 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.496557 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzx45\" (UniqueName: \"kubernetes.io/projected/2e899166-40ce-4fd8-9d09-3c945a004277-kube-api-access-gzx45\") pod \"iptables-alerter-qnf82\" (UID: \"2e899166-40ce-4fd8-9d09-3c945a004277\") " pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.496680 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.496593 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgwc6\" (UniqueName: \"kubernetes.io/projected/a3003f4c-5727-487b-a5a8-960a88011272-kube-api-access-cgwc6\") pod \"ovnkube-node-vcp5l\" (UID: \"a3003f4c-5727-487b-a5a8-960a88011272\") " pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.554770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.554708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" event={"ID":"38d375f9e4eff9d7cd26e8a8abd987f9","Type":"ContainerStarted","Data":"5d412f4ba7983b8e8da1fed1342c0115a365af38aaf02f28b178fc9d98c45f5b"} Jul 22 17:17:02.556099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.556061 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"1dbc543c56d8a4baafed4a2baef66d45","Type":"ContainerStarted","Data":"96213ffd7c012f137dd1497fcbbd69c821fbd4652a9749de04b39869e75af8da"} Jul 22 17:17:02.584900 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.584865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.584909 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-k8s-cni-cncf-io\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.584951 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-netns\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.584976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b4d76be-c869-4a60-8df1-0e96de9654ed-hosts-file\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-system-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cnibin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585123 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-netns\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cnibin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b4d76be-c869-4a60-8df1-0e96de9654ed-hosts-file\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-system-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-socket-dir-parent\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585173 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-cni-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585175 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-k8s-cni-cncf-io\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cni-binary-copy\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585267 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-socket-dir-parent\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5929ab95-84c7-49e8-99b9-5f795fdeb554-agent-certs\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4d76be-c869-4a60-8df1-0e96de9654ed-tmp-dir\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sslf\" (UniqueName: \"kubernetes.io/projected/b9de728b-83a2-464e-be35-04d26c6a8c60-kube-api-access-5sslf\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.585407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-conf-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-multus-certs\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pdh\" (UniqueName: \"kubernetes.io/projected/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-kube-api-access-c9pdh\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-kubelet\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585551 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z7g8\" (UniqueName: \"kubernetes.io/projected/acbce321-0157-468d-8dbe-88e47ffb0a30-kube-api-access-5z7g8\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585636 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-run-multus-certs\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-bin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585761 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-conf-dir\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585807 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-bin\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585816 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-cni-binary-copy\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585878 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-kubelet\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585903 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-registration-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-daemon-config\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5929ab95-84c7-49e8-99b9-5f795fdeb554-konnectivity-ca\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.586185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.585995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-hostroot\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586009 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586022 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-os-release\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586056 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-socket-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmtgx\" (UniqueName: \"kubernetes.io/projected/7b4d76be-c869-4a60-8df1-0e96de9654ed-kube-api-access-dmtgx\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-os-release\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b4d76be-c869-4a60-8df1-0e96de9654ed-tmp-dir\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586230 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-hostroot\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586265 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-sys-fs\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-etc-kubernetes\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkbk\" (UniqueName: \"kubernetes.io/projected/ad7a40b5-78a3-444b-a990-59ac7847f109-kube-api-access-ttkbk\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-os-release\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-multus\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586437 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-cnibin\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-device-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-system-cni-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-system-cni-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586576 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-multus-daemon-config\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-binary-copy\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5929ab95-84c7-49e8-99b9-5f795fdeb554-konnectivity-ca\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586587 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-etc-kubernetes\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586647 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-cnibin\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.586660 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586692 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-device-dir\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.586709 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.086696228 +0000 UTC m=+3.103041435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586707 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-os-release\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586729 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad7a40b5-78a3-444b-a990-59ac7847f109-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-host-var-lib-cni-multus\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586817 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acbce321-0157-468d-8dbe-88e47ffb0a30-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.587815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.586951 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ad7a40b5-78a3-444b-a990-59ac7847f109-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.589365 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.589341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5929ab95-84c7-49e8-99b9-5f795fdeb554-agent-certs\") pod \"konnectivity-agent-vwndh\" (UID: \"5929ab95-84c7-49e8-99b9-5f795fdeb554\") " pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.595835 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.595773 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sslf\" (UniqueName: \"kubernetes.io/projected/b9de728b-83a2-464e-be35-04d26c6a8c60-kube-api-access-5sslf\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:02.598846 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.598820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmtgx\" (UniqueName: \"kubernetes.io/projected/7b4d76be-c869-4a60-8df1-0e96de9654ed-kube-api-access-dmtgx\") pod \"node-resolver-wf9ml\" (UID: \"7b4d76be-c869-4a60-8df1-0e96de9654ed\") " pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.599658 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.599630 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z7g8\" (UniqueName: \"kubernetes.io/projected/acbce321-0157-468d-8dbe-88e47ffb0a30-kube-api-access-5z7g8\") pod \"aws-ebs-csi-driver-node-8g6jn\" (UID: \"acbce321-0157-468d-8dbe-88e47ffb0a30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.600330 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.600304 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttkbk\" (UniqueName: \"kubernetes.io/projected/ad7a40b5-78a3-444b-a990-59ac7847f109-kube-api-access-ttkbk\") pod \"multus-additional-cni-plugins-gf4tx\" (UID: \"ad7a40b5-78a3-444b-a990-59ac7847f109\") " pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.601510 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.601489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pdh\" (UniqueName: \"kubernetes.io/projected/d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd-kube-api-access-c9pdh\") pod \"multus-29qvb\" (UID: \"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd\") " pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.673654 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.673616 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnf82" Jul 22 17:17:02.686518 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:02.686478 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e899166_40ce_4fd8_9d09_3c945a004277.slice/crio-cef8366029f656b0337afdfb3da2123b482f97e68a0663b402205d9bada2115a WatchSource:0}: Error finding container cef8366029f656b0337afdfb3da2123b482f97e68a0663b402205d9bada2115a: Status 404 returned error can't find the container with id cef8366029f656b0337afdfb3da2123b482f97e68a0663b402205d9bada2115a Jul 22 17:17:02.687440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.687413 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:02.698433 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:02.698407 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3003f4c_5727_487b_a5a8_960a88011272.slice/crio-07c8c9d01a15364eb22ddcacdec47c09d4b9d6b59b695e8546e9f7cc32fd144c WatchSource:0}: Error finding container 07c8c9d01a15364eb22ddcacdec47c09d4b9d6b59b695e8546e9f7cc32fd144c: Status 404 returned error can't find the container with id 07c8c9d01a15364eb22ddcacdec47c09d4b9d6b59b695e8546e9f7cc32fd144c Jul 22 17:17:02.699288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.699263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" Jul 22 17:17:02.708149 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:02.708124 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba71b82b_a4c4_40f8_9c36_2dead93d7b0b.slice/crio-c4ca08471666607a858c425077c2c2ddfe7f3366debc817e183b5ea966e53cfe WatchSource:0}: Error finding container c4ca08471666607a858c425077c2c2ddfe7f3366debc817e183b5ea966e53cfe: Status 404 returned error can't find the container with id c4ca08471666607a858c425077c2c2ddfe7f3366debc817e183b5ea966e53cfe Jul 22 17:17:02.709498 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.709437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s52n" Jul 22 17:17:02.718644 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.718620 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" Jul 22 17:17:02.729499 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.729477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" Jul 22 17:17:02.736421 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.736399 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wf9ml" Jul 22 17:17:02.746166 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.746144 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-29qvb" Jul 22 17:17:02.752112 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.752087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:02.814191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.814159 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 17:17:02.990110 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.990071 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:02.990296 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:02.990125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:02.990296 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990240 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.990296 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990275 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:02.990447 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990300 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:02.990447 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990310 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.990291642 +0000 UTC m=+4.006636853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:02.990447 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990323 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:02.990447 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:02.990378 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:03.99036182 +0000 UTC m=+4.006707029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:03.090764 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.090735 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:03.090927 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.090865 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:03.090927 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.090934 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:04.090916741 +0000 UTC m=+4.107261949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:03.408900 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.408818 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 17:12:03 +0000 UTC" deadline="2027-12-17 18:43:06.854654023 +0000 UTC" Jul 22 17:17:03.408900 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.408853 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12313h26m3.445805376s" Jul 22 17:17:03.550236 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.550206 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:03.550831 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.550343 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:03.558848 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.558814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" event={"ID":"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b","Type":"ContainerStarted","Data":"c4ca08471666607a858c425077c2c2ddfe7f3366debc817e183b5ea966e53cfe"} Jul 22 17:17:03.560436 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.560394 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"07c8c9d01a15364eb22ddcacdec47c09d4b9d6b59b695e8546e9f7cc32fd144c"} Jul 22 17:17:03.562001 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.561952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnf82" event={"ID":"2e899166-40ce-4fd8-9d09-3c945a004277","Type":"ContainerStarted","Data":"cef8366029f656b0337afdfb3da2123b482f97e68a0663b402205d9bada2115a"} Jul 22 17:17:03.841366 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.841315 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44e6d93_48a0_4a1e_8fa1_8268eaf2b8bd.slice/crio-5e888325650da1cdd3be3d77155686b4629d203215123ce2d94671237c00497a WatchSource:0}: Error finding container 5e888325650da1cdd3be3d77155686b4629d203215123ce2d94671237c00497a: Status 404 returned error can't find the container with id 5e888325650da1cdd3be3d77155686b4629d203215123ce2d94671237c00497a Jul 22 17:17:03.842663 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.842618 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7a40b5_78a3_444b_a990_59ac7847f109.slice/crio-23c57c9aeace7299996e8de7031943ce8860c364f01683831435792eb1b9a56d WatchSource:0}: Error finding container 23c57c9aeace7299996e8de7031943ce8860c364f01683831435792eb1b9a56d: Status 404 returned error can't find the container with id 23c57c9aeace7299996e8de7031943ce8860c364f01683831435792eb1b9a56d Jul 22 17:17:03.843338 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.843277 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbce321_0157_468d_8dbe_88e47ffb0a30.slice/crio-d77653fde3dcb7094af5b942a0305cd6c4d410a92c14400b0c49d04270e8d1a6 WatchSource:0}: Error finding container d77653fde3dcb7094af5b942a0305cd6c4d410a92c14400b0c49d04270e8d1a6: Status 404 returned error can't find the container with id d77653fde3dcb7094af5b942a0305cd6c4d410a92c14400b0c49d04270e8d1a6 Jul 22 17:17:03.847788 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.847760 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4d76be_c869_4a60_8df1_0e96de9654ed.slice/crio-1a01285028456ceaad963d735b32282af71182dfeb20f6391b01723340bd38dd WatchSource:0}: Error finding container 1a01285028456ceaad963d735b32282af71182dfeb20f6391b01723340bd38dd: Status 404 returned error can't find the container with id 1a01285028456ceaad963d735b32282af71182dfeb20f6391b01723340bd38dd Jul 22 17:17:03.852758 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.851270 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5929ab95_84c7_49e8_99b9_5f795fdeb554.slice/crio-fa312136b5cb0df823ab7c44075d4e8c3530a582934fb9df9c73cb22bbe427ad WatchSource:0}: Error finding container fa312136b5cb0df823ab7c44075d4e8c3530a582934fb9df9c73cb22bbe427ad: Status 404 returned error can't find the container with id fa312136b5cb0df823ab7c44075d4e8c3530a582934fb9df9c73cb22bbe427ad Jul 22 17:17:03.852758 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:03.852232 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465ab9d1_327f_41fb_ac50_975f7d37ab23.slice/crio-4faa72b205d854211fcc12acdcd8818490e767b12417db8bfee492319417a20d WatchSource:0}: Error finding container 4faa72b205d854211fcc12acdcd8818490e767b12417db8bfee492319417a20d: Status 404 returned error can't find the container with id 4faa72b205d854211fcc12acdcd8818490e767b12417db8bfee492319417a20d Jul 22 17:17:03.997591 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.997558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:03.997591 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:03.997599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:03.997877 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.997715 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:03.997877 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.997763 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:05.997750207 +0000 UTC m=+6.014095414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:03.998048 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.998023 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:03.998116 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.998062 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:03.998116 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.998090 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:03.998220 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:03.998144 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:05.998125777 +0000 UTC m=+6.014471004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:04.099472 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.098571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:04.099472 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:04.099007 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:04.099472 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:04.099095 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:06.099073861 +0000 UTC m=+6.115419070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:04.409194 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.409040 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 17:12:03 +0000 UTC" deadline="2028-01-04 19:42:52.470718967 +0000 UTC" Jul 22 17:17:04.409194 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.409107 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12746h25m48.0616164s" Jul 22 17:17:04.552056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.551518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:04.552056 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:04.551661 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:04.552056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.551518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:04.552897 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:04.552134 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:04.569809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.569029 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" event={"ID":"38d375f9e4eff9d7cd26e8a8abd987f9","Type":"ContainerStarted","Data":"b033ccc94c0a140fd9b0b559faefe0921ee5ef042c50ed2387cb3d91fe51937e"} Jul 22 17:17:04.582344 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.582304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s52n" event={"ID":"465ab9d1-327f-41fb-ac50-975f7d37ab23","Type":"ContainerStarted","Data":"4faa72b205d854211fcc12acdcd8818490e767b12417db8bfee492319417a20d"} Jul 22 17:17:04.584242 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.584187 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-17.ec2.internal" podStartSLOduration=2.58416945 podStartE2EDuration="2.58416945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:04.583782586 +0000 UTC m=+4.600127813" watchObservedRunningTime="2026-07-22 17:17:04.58416945 +0000 UTC m=+4.600514682" Jul 22 17:17:04.590610 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.590580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vwndh" event={"ID":"5929ab95-84c7-49e8-99b9-5f795fdeb554","Type":"ContainerStarted","Data":"fa312136b5cb0df823ab7c44075d4e8c3530a582934fb9df9c73cb22bbe427ad"} Jul 22 17:17:04.594796 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.594766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wf9ml" event={"ID":"7b4d76be-c869-4a60-8df1-0e96de9654ed","Type":"ContainerStarted","Data":"1a01285028456ceaad963d735b32282af71182dfeb20f6391b01723340bd38dd"} Jul 22 17:17:04.604143 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.604067 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" event={"ID":"acbce321-0157-468d-8dbe-88e47ffb0a30","Type":"ContainerStarted","Data":"d77653fde3dcb7094af5b942a0305cd6c4d410a92c14400b0c49d04270e8d1a6"} Jul 22 17:17:04.612506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.612440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerStarted","Data":"23c57c9aeace7299996e8de7031943ce8860c364f01683831435792eb1b9a56d"} Jul 22 17:17:04.623782 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.623713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29qvb" event={"ID":"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd","Type":"ContainerStarted","Data":"5e888325650da1cdd3be3d77155686b4629d203215123ce2d94671237c00497a"} Jul 22 17:17:04.634700 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.634639 2582 generic.go:356] "Generic (PLEG): container finished" podID="1dbc543c56d8a4baafed4a2baef66d45" containerID="5e985bdefa4a10dfd4334599d17d88ec8077f1d602ad84b4197a623121ef66b5" exitCode=0 Jul 22 17:17:04.634700 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:04.634678 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"1dbc543c56d8a4baafed4a2baef66d45","Type":"ContainerDied","Data":"5e985bdefa4a10dfd4334599d17d88ec8077f1d602ad84b4197a623121ef66b5"} Jul 22 17:17:05.552159 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:05.551590 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:05.552159 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:05.551732 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:05.654114 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:05.654054 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" event={"ID":"1dbc543c56d8a4baafed4a2baef66d45","Type":"ContainerStarted","Data":"4689f2456a75c8cfa4f3130163da8c3de7a435597d186fa8130e6ae6be7606bd"} Jul 22 17:17:05.677910 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:05.677844 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-17.ec2.internal" podStartSLOduration=3.677821964 podStartE2EDuration="3.677821964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:05.677176641 +0000 UTC m=+5.693521871" watchObservedRunningTime="2026-07-22 17:17:05.677821964 +0000 UTC m=+5.694167197" Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:06.017000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:06.017059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017224 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017290 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:10.017269539 +0000 UTC m=+10.033614771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017741 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017762 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017776 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:06.017893 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.017824 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:10.017807079 +0000 UTC m=+10.034152286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:06.117707 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:06.117671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:06.117906 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.117854 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:06.117975 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.117918 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:10.117897575 +0000 UTC m=+10.134242782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:06.550750 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:06.550127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:06.550750 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.550302 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:06.551261 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:06.551087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:06.551261 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:06.551194 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:07.550261 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:07.549651 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:07.550261 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:07.549854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:08.553439 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:08.552761 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:08.553439 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:08.552919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:08.553439 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:08.553377 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:08.554103 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:08.553480 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:09.549737 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:09.549654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:09.549928 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:09.549800 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:10.055553 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:10.055511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:10.055564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055691 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055719 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055749 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055761 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:18.055742582 +0000 UTC m=+18.072087791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055766 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:10.056090 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.055825 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:18.05580677 +0000 UTC m=+18.072151979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:10.156388 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:10.156254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:10.156577 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.156406 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:10.156577 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.156493 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:18.15646972 +0000 UTC m=+18.172814929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:10.551190 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:10.550527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:10.551190 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.550661 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:10.551190 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:10.550727 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:10.551190 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:10.550801 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:11.550298 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:11.550172 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:11.550771 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:11.550310 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:12.549561 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:12.549420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:12.549561 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:12.549420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:12.549806 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:12.549598 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:12.549806 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:12.549747 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:13.549831 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:13.549790 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:13.550326 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:13.549945 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:14.550262 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:14.550236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:14.550622 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:14.550331 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:14.550622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:14.550409 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:14.550622 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:14.550502 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:15.549594 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:15.549558 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:15.549736 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:15.549678 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:16.550140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:16.550106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:16.550575 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:16.550106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:16.550575 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:16.550251 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:16.550575 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:16.550321 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:17.549942 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:17.549890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:17.550137 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:17.550030 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:18.121757 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:18.121718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:18.121767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121874 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121903 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121941 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121954 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:34.121936604 +0000 UTC m=+34.138281834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121956 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:18.122218 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.121994 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:17:34.121987506 +0000 UTC m=+34.138332711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:18.222375 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:18.222337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:18.222540 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.222501 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:18.222611 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.222581 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:17:34.222560143 +0000 UTC m=+34.238905359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:18.549693 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:18.549660 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:18.549855 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:18.549768 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:18.549914 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.549872 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:18.549914 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:18.549854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:19.549831 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:19.549797 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:19.550301 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:19.549910 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:20.550755 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:20.550715 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:20.550755 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:20.550761 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:20.551315 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:20.550851 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:20.551315 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:20.551007 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:21.549870 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:21.549835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:21.550056 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:21.549987 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:22.549935 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:22.549879 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:22.549935 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:22.549914 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:22.550461 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:22.550065 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:22.550461 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:22.550388 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:23.549971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.549759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:23.550484 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:23.550036 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:23.691776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.691740 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" event={"ID":"ba71b82b-a4c4-40f8-9c36-2dead93d7b0b","Type":"ContainerStarted","Data":"38279744ce217dac7db69a6f45388c5193327ed9326c9ee3c13647e772b6c19f"} Jul 22 17:17:23.694551 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.694531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:17:23.695049 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.695014 2582 generic.go:356] "Generic (PLEG): container finished" podID="a3003f4c-5727-487b-a5a8-960a88011272" containerID="956e5346bb51e6a6a0e1e7010b26e64feadf9505aa63ce56e3afce681c9187a9" exitCode=1 Jul 22 17:17:23.695158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.695105 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"fa24b9fbf2d19417cc53765c28a1a2bf83820f284835d1144c00cce96ff964d7"} Jul 22 17:17:23.695218 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.695180 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"d73e341b1e9e11778284c13056736e0f1c0c71aa49720808006d669a4416b41f"} Jul 22 17:17:23.695274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.695237 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerDied","Data":"956e5346bb51e6a6a0e1e7010b26e64feadf9505aa63ce56e3afce681c9187a9"} Jul 22 17:17:23.695366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.695278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"bdcd08a07b4efa21605487917e5205c8530353125bcaf8b8f80a19dafe74a39c"} Jul 22 17:17:23.696793 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.696771 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s52n" event={"ID":"465ab9d1-327f-41fb-ac50-975f7d37ab23","Type":"ContainerStarted","Data":"2b2872c955e14dafd04c374622edb43a8b90c3ebaf2c5fb873c65991a75211cb"} Jul 22 17:17:23.698415 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.698378 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vwndh" event={"ID":"5929ab95-84c7-49e8-99b9-5f795fdeb554","Type":"ContainerStarted","Data":"4c04213f890207496a280d81ec732411a4ca78d5435330b04aec29d8f6cbae7f"} Jul 22 17:17:23.700168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.700145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wf9ml" event={"ID":"7b4d76be-c869-4a60-8df1-0e96de9654ed","Type":"ContainerStarted","Data":"debf24104f9adc0848b92db3bcef77a7467697f796da7e42438da0852ff915da"} Jul 22 17:17:23.701803 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.701779 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" event={"ID":"acbce321-0157-468d-8dbe-88e47ffb0a30","Type":"ContainerStarted","Data":"49c8515126ecb884ffdbecfc3103a881407ea7b6e030401cc44b053253ac885a"} Jul 22 17:17:23.703446 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.703425 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="82dd9754d56166d40bfae9b9f5492b6bd1693cf068cae8c0fae8ba430ac853e0" exitCode=0 Jul 22 17:17:23.703626 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.703577 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"82dd9754d56166d40bfae9b9f5492b6bd1693cf068cae8c0fae8ba430ac853e0"} Jul 22 17:17:23.705451 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.705428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-29qvb" event={"ID":"d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd","Type":"ContainerStarted","Data":"ac39ac9afb9b59a6d47dad568d995ba30544de67f5d08d289aad1594041a70a9"} Jul 22 17:17:23.709885 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.709817 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zcdz" podStartSLOduration=2.456155309 podStartE2EDuration="22.709805856s" totalImagesPullingTime="20.253650547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.709345994 +0000 UTC m=+23.725691222" watchObservedRunningTime="2026-07-22 17:17:23.709805856 +0000 UTC m=+23.726151083" Jul 22 17:17:23.747577 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.747531 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-29qvb" podStartSLOduration=3.596952949 podStartE2EDuration="22.7475129s" totalImagesPullingTime="19.150559951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.747443226 +0000 UTC m=+23.763788480" watchObservedRunningTime="2026-07-22 17:17:23.7475129 +0000 UTC m=+23.763858127" Jul 22 17:17:23.748051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.748019 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wf9ml" podStartSLOduration=3.618452329 podStartE2EDuration="22.74801013s" totalImagesPullingTime="19.129557801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.728201431 +0000 UTC m=+23.744546658" watchObservedRunningTime="2026-07-22 17:17:23.74801013 +0000 UTC m=+23.764355358" Jul 22 17:17:23.764145 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:23.764097 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vwndh" podStartSLOduration=3.6534415019999997 podStartE2EDuration="22.764082042s" totalImagesPullingTime="19.11064054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.76355086 +0000 UTC m=+23.779896087" watchObservedRunningTime="2026-07-22 17:17:23.764082042 +0000 UTC m=+23.780427268" Jul 22 17:17:24.513324 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.513288 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 17:17:24.549780 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.549522 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:24.549780 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.549523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:24.549780 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:24.549659 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:24.549780 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:24.549720 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:24.711460 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.711428 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:17:24.711905 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.711876 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"01171d6f371150ca6fa30d18d0ef7f0b2e4527506cc073065acf823bb9f5fcc9"} Jul 22 17:17:24.712062 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.711992 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"8715cb10cc9cb8fd354dc43aaf15fff1a5cc2b05166517a695bd081c5f6d8a57"} Jul 22 17:17:24.713820 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.713776 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" event={"ID":"acbce321-0157-468d-8dbe-88e47ffb0a30","Type":"ContainerStarted","Data":"32fc99a96a6994ba7bb1132f29c20e285403ffa850dd318574b82e7e9693a212"} Jul 22 17:17:24.717759 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.717684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnf82" event={"ID":"2e899166-40ce-4fd8-9d09-3c945a004277","Type":"ContainerStarted","Data":"5f8391c86dfbf024cce7ff2b0f8dbba9b7d5a22a0ca91374362cd95e65bbac5f"} Jul 22 17:17:24.733036 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.732992 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8s52n" podStartSLOduration=4.624666372 podStartE2EDuration="23.732975393s" totalImagesPullingTime="19.108309021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:23.815081851 +0000 UTC m=+23.831427078" watchObservedRunningTime="2026-07-22 17:17:24.732975393 +0000 UTC m=+24.749320629" Jul 22 17:17:24.733281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:24.733258 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qnf82" podStartSLOduration=3.458847649 podStartE2EDuration="23.733252984s" totalImagesPullingTime="20.274405335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:24.732858051 +0000 UTC m=+24.749203280" watchObservedRunningTime="2026-07-22 17:17:24.733252984 +0000 UTC m=+24.749598221" Jul 22 17:17:25.448159 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:25.448054 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T17:17:24.513307875Z","UUID":"a5999c20-fd76-4bf9-bea2-44713f24f339","Handler":null,"Name":"","Endpoint":""} Jul 22 17:17:25.449801 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:25.449776 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 17:17:25.449948 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:25.449823 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 17:17:25.549618 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:25.549581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:25.549800 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:25.549729 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:26.422622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.422551 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:26.423250 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.423231 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:26.550384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.550355 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:26.550533 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:26.550490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:26.550601 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.550537 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:26.550699 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:26.550677 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:26.725489 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.725447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" event={"ID":"acbce321-0157-468d-8dbe-88e47ffb0a30","Type":"ContainerStarted","Data":"36ec35f8621da5ed60f8fdd0ede519084b5bc32ae5792833ba5a7ae8c2209562"} Jul 22 17:17:26.729086 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.729047 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:17:26.729496 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.729466 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"d3ea30896cc0e71332bdbe317fb38f4014b3e912caf365fe2be7485d54e98034"} Jul 22 17:17:26.729765 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.729745 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:26.730281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.730264 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vwndh" Jul 22 17:17:26.743486 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:26.743446 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g6jn" podStartSLOduration=4.007307322 podStartE2EDuration="25.743426909s" totalImagesPullingTime="21.736119587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:26.74333515 +0000 UTC m=+26.759680433" watchObservedRunningTime="2026-07-22 17:17:26.743426909 +0000 UTC m=+26.759772136" Jul 22 17:17:27.550213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:27.550039 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:27.550665 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:27.550296 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:28.549635 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.549601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:28.549799 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:28.549744 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:28.549857 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.549798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:28.549979 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:28.549948 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:28.737734 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.737704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:17:28.738557 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.738107 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"eefff4c7f0d08bf68e7da3193917629b2b765293cdef625ef2a287de9b8a7514"} Jul 22 17:17:28.738557 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.738383 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:28.738654 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.738564 2582 scope.go:117] "RemoveContainer" containerID="956e5346bb51e6a6a0e1e7010b26e64feadf9505aa63ce56e3afce681c9187a9" Jul 22 17:17:28.740145 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.740118 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="3effb199c736732d1ae23e70ac79077fcfe865bf42394dadd46986f54a3981f1" exitCode=0 Jul 22 17:17:28.740256 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.740205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"3effb199c736732d1ae23e70ac79077fcfe865bf42394dadd46986f54a3981f1"} Jul 22 17:17:28.757006 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:28.755304 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:29.549718 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.549688 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:29.550027 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:29.549803 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:29.747104 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.747079 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:17:29.747520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.747499 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" event={"ID":"a3003f4c-5727-487b-a5a8-960a88011272","Type":"ContainerStarted","Data":"f5a5c7eaa17b3b082df2d09cb06ded798c7d40d9db10b2f34e373905fb30a846"} Jul 22 17:17:29.747681 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.747664 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:29.747786 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.747769 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:29.762645 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.762621 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:17:29.783217 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:29.783166 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" podStartSLOduration=8.291117844 podStartE2EDuration="28.783148023s" totalImagesPullingTime="20.492030179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:29.781857194 +0000 UTC m=+29.798202433" watchObservedRunningTime="2026-07-22 17:17:29.783148023 +0000 UTC m=+29.799493251" Jul 22 17:17:30.230269 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.230237 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvfvp"] Jul 22 17:17:30.230456 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.230364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:30.233585 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:30.230784 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:30.233827 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.233778 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcq4h"] Jul 22 17:17:30.234235 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.234218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:30.234328 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:30.234301 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:30.248818 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.248784 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sr8m6"] Jul 22 17:17:30.249020 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.248889 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:30.249020 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:30.248982 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:30.751290 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.751260 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="c79f459a2e5fc283b53cc624c19133234e644b6f1d8684011772ea389d34ea5d" exitCode=0 Jul 22 17:17:30.751731 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:30.751355 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"c79f459a2e5fc283b53cc624c19133234e644b6f1d8684011772ea389d34ea5d"} Jul 22 17:17:31.098939 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.098855 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wf9ml_7b4d76be-c869-4a60-8df1-0e96de9654ed/dns-node-resolver/0.log" Jul 22 17:17:31.550185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.550155 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:31.550303 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:31.550281 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:31.550380 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.550364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:31.550496 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:31.550478 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:31.665151 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.665133 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s52n_465ab9d1-327f-41fb-ac50-975f7d37ab23/node-ca/0.log" Jul 22 17:17:31.755513 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.755452 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="57436fc567c9a7d3b6bd97d573a1b9ab558785fbbcaa0bc65beaacc0978dc274" exitCode=0 Jul 22 17:17:31.755818 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:31.755533 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"57436fc567c9a7d3b6bd97d573a1b9ab558785fbbcaa0bc65beaacc0978dc274"} Jul 22 17:17:32.550196 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:32.550114 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:32.550354 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:32.550225 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:33.550335 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:33.550304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:33.550817 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:33.550428 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:33.550817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:33.550477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:33.550817 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:33.550581 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:34.140757 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:34.140718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:34.140959 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:34.140771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:34.140959 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.140886 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 17:17:34.140959 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.140906 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 17:17:34.140959 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.140916 2582 projected.go:196] Error preparing data for projected volume kube-api-access-gpskg for pod openshift-network-diagnostics/network-check-target-sr8m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:34.140959 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.140952 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:34.141233 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.140990 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg podName:6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e nodeName:}" failed. No retries permitted until 2026-07-22 17:18:06.140970347 +0000 UTC m=+66.157315572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gpskg" (UniqueName: "kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg") pod "network-check-target-sr8m6" (UID: "6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 17:17:34.141233 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.141014 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret podName:d42dbc1c-eaaf-44db-a51e-50877be12332 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:06.140996602 +0000 UTC m=+66.157341810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret") pod "global-pull-secret-syncer-tcq4h" (UID: "d42dbc1c-eaaf-44db-a51e-50877be12332") : object "kube-system"/"original-pull-secret" not registered Jul 22 17:17:34.241622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:34.241594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:34.241781 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.241718 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:34.241834 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.241784 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs podName:b9de728b-83a2-464e-be35-04d26c6a8c60 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:06.241768808 +0000 UTC m=+66.258114017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs") pod "network-metrics-daemon-rvfvp" (UID: "b9de728b-83a2-464e-be35-04d26c6a8c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 17:17:34.549995 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:34.549967 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:34.550172 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:34.550075 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:35.550281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:35.550250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:35.550281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:35.550290 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:35.550972 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:35.550385 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:35.550972 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:35.550528 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:36.550437 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:36.550407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:36.550723 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:36.550538 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:36.769965 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:36.769934 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="61a98fef742b35e81dfed5bb57eb2739e918f1f37e3c101e44446624664921f6" exitCode=0 Jul 22 17:17:36.770077 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:36.769975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"61a98fef742b35e81dfed5bb57eb2739e918f1f37e3c101e44446624664921f6"} Jul 22 17:17:37.549942 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:37.549891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:37.550129 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:37.549950 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:37.550129 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:37.550016 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:37.550246 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:37.550149 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:37.774571 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:37.774542 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad7a40b5-78a3-444b-a990-59ac7847f109" containerID="56c7d9724f3ee509b337b749388b0355db922980cdc3c3375fe7f805e09e4632" exitCode=0 Jul 22 17:17:37.775035 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:37.774577 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerDied","Data":"56c7d9724f3ee509b337b749388b0355db922980cdc3c3375fe7f805e09e4632"} Jul 22 17:17:38.549560 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:38.549521 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:38.549742 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:38.549632 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:38.779600 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:38.779572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" event={"ID":"ad7a40b5-78a3-444b-a990-59ac7847f109","Type":"ContainerStarted","Data":"aaba3b6c0139ba6617f15e94b71f35cd2e5fbc734b27aafd7d8d529473afbe96"} Jul 22 17:17:39.549670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:39.549473 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:39.549849 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:39.549546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:39.549849 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:39.549746 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:39.549849 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:39.549814 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:40.550900 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:40.550867 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:40.551266 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:40.550993 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:41.550362 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:41.550326 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:41.550362 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:41.550348 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:41.550543 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:41.550444 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:41.550603 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:41.550585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:42.550012 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:42.549981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:42.550381 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:42.550079 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:43.550125 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:43.550090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:43.550125 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:43.550127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:43.550525 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:43.550204 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:43.550525 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:43.550258 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:44.549963 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:44.549932 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:44.550136 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:44.550025 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:45.550284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:45.550250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:45.550673 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:45.550250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:45.550673 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:45.550369 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:45.550673 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:45.550459 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:46.550145 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:46.550108 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:46.550394 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:46.550216 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:47.549522 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:47.549477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:47.549716 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:47.549490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:47.549716 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:47.549589 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:47.549716 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:47.549680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:48.549916 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:48.549884 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:48.550279 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:48.550005 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:49.549695 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:49.549662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:49.549884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:49.549665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:49.549884 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:49.549769 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:49.549884 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:49.549852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:50.552416 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:50.552382 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:50.552835 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:50.552493 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:51.550294 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:51.550251 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:51.550294 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:51.550290 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:51.550497 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:51.550377 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:51.550533 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:51.550504 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:52.552401 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:52.552367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:52.552855 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:52.552478 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:53.549940 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:53.549904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:53.550202 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:53.549904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:53.550202 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:53.550020 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:53.550202 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:53.550093 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:54.550223 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:54.550193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:54.550612 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:54.550299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:55.550111 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:55.550071 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:55.550284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:55.550071 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:55.550284 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:55.550209 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcq4h" podUID="d42dbc1c-eaaf-44db-a51e-50877be12332" Jul 22 17:17:55.550284 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:55.550257 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvfvp" podUID="b9de728b-83a2-464e-be35-04d26c6a8c60" Jul 22 17:17:56.549567 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.549512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:56.549772 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:17:56.549634 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sr8m6" podUID="6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e" Jul 22 17:17:56.828372 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.828263 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-17.ec2.internal" event="NodeReady" Jul 22 17:17:56.828756 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.828429 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 17:17:56.892826 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.892742 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gf4tx" podStartSLOduration=25.657709177 podStartE2EDuration="55.892723164s" totalImagesPullingTime="30.235013987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:38.812989384 +0000 UTC m=+38.829334612" watchObservedRunningTime="2026-07-22 17:17:56.892723164 +0000 UTC m=+56.909068392" Jul 22 17:17:56.893429 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.893411 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-678b96d48c-zpfrz"] Jul 22 17:17:56.895134 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.895119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:56.897915 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.897889 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 17:17:56.898055 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.897888 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 17:17:56.898055 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.897905 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r79sn\"" Jul 22 17:17:56.899447 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.899425 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 17:17:56.904390 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.904372 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 17:17:56.916481 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.916452 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c4vh4"] Jul 22 17:17:56.918187 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.918168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:56.920361 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.920338 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5ptkt\"" Jul 22 17:17:56.921092 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.921062 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 17:17:56.921201 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.921133 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 17:17:56.924849 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.924821 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678b96d48c-zpfrz"] Jul 22 17:17:56.935982 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.935959 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c4vh4"] Jul 22 17:17:56.941814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.941329 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7frk7"] Jul 22 17:17:56.943212 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.943189 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:56.948603 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.948582 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 17:17:56.949106 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.949076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 17:17:56.949239 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.949099 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qg6w7\"" Jul 22 17:17:56.949327 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.949313 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 17:17:56.960181 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:56.960158 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7frk7"] Jul 22 17:17:57.016088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016055 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-certificates\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f196aa45-596e-456e-b5a8-78883e5afba0-config-volume\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f196aa45-596e-456e-b5a8-78883e5afba0-tmp-dir\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-tls\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016214 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f196aa45-596e-456e-b5a8-78883e5afba0-metrics-tls\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbe75056-fd3e-4945-bb17-026ca74b45a1-ca-trust-extracted\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-installation-pull-secrets\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016494 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-bound-sa-token\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016494 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9npr\" (UniqueName: \"kubernetes.io/projected/4c7e4c78-d1f7-402a-b9ac-422077891d51-kube-api-access-c9npr\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.016494 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nc65\" (UniqueName: \"kubernetes.io/projected/f196aa45-596e-456e-b5a8-78883e5afba0-kube-api-access-4nc65\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.016494 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-image-registry-private-configuration\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016494 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-trusted-ca\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016680 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hrd\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-kube-api-access-78hrd\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.016680 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.016524 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c7e4c78-d1f7-402a-b9ac-422077891d51-cert\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.017590 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.017568 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zffcd"] Jul 22 17:17:57.019315 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.019301 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.022071 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.022049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 17:17:57.022904 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.022869 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 17:17:57.023689 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.023437 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgstf\"" Jul 22 17:17:57.023972 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.023953 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 17:17:57.024057 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.024012 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 17:17:57.042693 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.042659 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zffcd"] Jul 22 17:17:57.117824 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g46jq\" (UniqueName: \"kubernetes.io/projected/da17968e-0310-4555-9b44-a45a5fa124c8-kube-api-access-g46jq\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.117824 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-certificates\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.117824 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f196aa45-596e-456e-b5a8-78883e5afba0-config-volume\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f196aa45-596e-456e-b5a8-78883e5afba0-tmp-dir\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-tls\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.117999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f196aa45-596e-456e-b5a8-78883e5afba0-metrics-tls\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbe75056-fd3e-4945-bb17-026ca74b45a1-ca-trust-extracted\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-installation-pull-secrets\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-bound-sa-token\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118155 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9npr\" (UniqueName: \"kubernetes.io/projected/4c7e4c78-d1f7-402a-b9ac-422077891d51-kube-api-access-c9npr\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nc65\" (UniqueName: \"kubernetes.io/projected/f196aa45-596e-456e-b5a8-78883e5afba0-kube-api-access-4nc65\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-image-registry-private-configuration\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da17968e-0310-4555-9b44-a45a5fa124c8-crio-socket\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118255 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f196aa45-596e-456e-b5a8-78883e5afba0-tmp-dir\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da17968e-0310-4555-9b44-a45a5fa124c8-data-volume\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da17968e-0310-4555-9b44-a45a5fa124c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da17968e-0310-4555-9b44-a45a5fa124c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-trusted-ca\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hrd\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-kube-api-access-78hrd\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c7e4c78-d1f7-402a-b9ac-422077891d51-cert\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.118864 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118446 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbe75056-fd3e-4945-bb17-026ca74b45a1-ca-trust-extracted\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.118864 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118567 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f196aa45-596e-456e-b5a8-78883e5afba0-config-volume\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.118864 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.118735 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-certificates\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.119561 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.119533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbe75056-fd3e-4945-bb17-026ca74b45a1-trusted-ca\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.122388 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.122360 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-image-registry-private-configuration\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.122480 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.122368 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f196aa45-596e-456e-b5a8-78883e5afba0-metrics-tls\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.122480 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.122408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-registry-tls\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.122480 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.122423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbe75056-fd3e-4945-bb17-026ca74b45a1-installation-pull-secrets\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.122480 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.122462 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c7e4c78-d1f7-402a-b9ac-422077891d51-cert\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.135942 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.135897 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-bound-sa-token\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.136262 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.136240 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nc65\" (UniqueName: \"kubernetes.io/projected/f196aa45-596e-456e-b5a8-78883e5afba0-kube-api-access-4nc65\") pod \"dns-default-c4vh4\" (UID: \"f196aa45-596e-456e-b5a8-78883e5afba0\") " pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.136411 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.136391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9npr\" (UniqueName: \"kubernetes.io/projected/4c7e4c78-d1f7-402a-b9ac-422077891d51-kube-api-access-c9npr\") pod \"ingress-canary-7frk7\" (UID: \"4c7e4c78-d1f7-402a-b9ac-422077891d51\") " pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.137550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.137525 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hrd\" (UniqueName: \"kubernetes.io/projected/dbe75056-fd3e-4945-bb17-026ca74b45a1-kube-api-access-78hrd\") pod \"image-registry-678b96d48c-zpfrz\" (UID: \"dbe75056-fd3e-4945-bb17-026ca74b45a1\") " pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.204425 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.204383 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.219108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da17968e-0310-4555-9b44-a45a5fa124c8-crio-socket\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da17968e-0310-4555-9b44-a45a5fa124c8-data-volume\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219303 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da17968e-0310-4555-9b44-a45a5fa124c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219303 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da17968e-0310-4555-9b44-a45a5fa124c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219303 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219165 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da17968e-0310-4555-9b44-a45a5fa124c8-crio-socket\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219303 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g46jq\" (UniqueName: \"kubernetes.io/projected/da17968e-0310-4555-9b44-a45a5fa124c8-kube-api-access-g46jq\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219503 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219484 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da17968e-0310-4555-9b44-a45a5fa124c8-data-volume\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.219713 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.219694 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da17968e-0310-4555-9b44-a45a5fa124c8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.221435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.221410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da17968e-0310-4555-9b44-a45a5fa124c8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.227017 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.226994 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c4vh4" Jul 22 17:17:57.227250 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.227230 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g46jq\" (UniqueName: \"kubernetes.io/projected/da17968e-0310-4555-9b44-a45a5fa124c8-kube-api-access-g46jq\") pod \"insights-runtime-extractor-zffcd\" (UID: \"da17968e-0310-4555-9b44-a45a5fa124c8\") " pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.252048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.252017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7frk7" Jul 22 17:17:57.329625 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.329290 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zffcd" Jul 22 17:17:57.361951 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.361850 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-678b96d48c-zpfrz"] Jul 22 17:17:57.386278 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.385894 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c4vh4"] Jul 22 17:17:57.398032 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:57.398002 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf196aa45_596e_456e_b5a8_78883e5afba0.slice/crio-bc4fe2fe88a155d8d6ec68d2db5bd814fd1f04237e3ad2b6da28ee2c9dd7f26d WatchSource:0}: Error finding container bc4fe2fe88a155d8d6ec68d2db5bd814fd1f04237e3ad2b6da28ee2c9dd7f26d: Status 404 returned error can't find the container with id bc4fe2fe88a155d8d6ec68d2db5bd814fd1f04237e3ad2b6da28ee2c9dd7f26d Jul 22 17:17:57.413754 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.413698 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7frk7"] Jul 22 17:17:57.416978 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:57.416950 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7e4c78_d1f7_402a_b9ac_422077891d51.slice/crio-e9a18221e8669fb824b58514da5c5403c3f8eb814534bf5b52e1114475fa8af9 WatchSource:0}: Error finding container e9a18221e8669fb824b58514da5c5403c3f8eb814534bf5b52e1114475fa8af9: Status 404 returned error can't find the container with id e9a18221e8669fb824b58514da5c5403c3f8eb814534bf5b52e1114475fa8af9 Jul 22 17:17:57.488482 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:17:57.488455 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda17968e_0310_4555_9b44_a45a5fa124c8.slice/crio-943d3313ae24d796ba1aac9eeebd97a5e7c2107d2116c17f53b7ca1de9fed0ea WatchSource:0}: Error finding container 943d3313ae24d796ba1aac9eeebd97a5e7c2107d2116c17f53b7ca1de9fed0ea: Status 404 returned error can't find the container with id 943d3313ae24d796ba1aac9eeebd97a5e7c2107d2116c17f53b7ca1de9fed0ea Jul 22 17:17:57.491342 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.491319 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zffcd"] Jul 22 17:17:57.550117 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.550085 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:17:57.550264 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.550094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:17:57.552488 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.552462 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvlz4\"" Jul 22 17:17:57.552883 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.552866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 17:17:57.553110 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.553096 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 17:17:57.819852 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.819817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7frk7" event={"ID":"4c7e4c78-d1f7-402a-b9ac-422077891d51","Type":"ContainerStarted","Data":"e9a18221e8669fb824b58514da5c5403c3f8eb814534bf5b52e1114475fa8af9"} Jul 22 17:17:57.820877 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.820852 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4vh4" event={"ID":"f196aa45-596e-456e-b5a8-78883e5afba0","Type":"ContainerStarted","Data":"bc4fe2fe88a155d8d6ec68d2db5bd814fd1f04237e3ad2b6da28ee2c9dd7f26d"} Jul 22 17:17:57.821832 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.821812 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zffcd" event={"ID":"da17968e-0310-4555-9b44-a45a5fa124c8","Type":"ContainerStarted","Data":"943d3313ae24d796ba1aac9eeebd97a5e7c2107d2116c17f53b7ca1de9fed0ea"} Jul 22 17:17:57.823099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.823076 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" event={"ID":"dbe75056-fd3e-4945-bb17-026ca74b45a1","Type":"ContainerStarted","Data":"4b1eb50f00e3b1170e8666a61a835f4e80b40fbee55fe37f9545f2ec3b0d6bf8"} Jul 22 17:17:57.823177 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.823115 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" event={"ID":"dbe75056-fd3e-4945-bb17-026ca74b45a1","Type":"ContainerStarted","Data":"7a292a37b283adae9c23ca6d48b261ce9fa195cf86d00ede70097a73e95a4a78"} Jul 22 17:17:57.823222 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.823204 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:17:57.846022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:57.845967 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" podStartSLOduration=1.8459468989999999 podStartE2EDuration="1.845946899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:17:57.845546223 +0000 UTC m=+57.861891432" watchObservedRunningTime="2026-07-22 17:17:57.845946899 +0000 UTC m=+57.862292117" Jul 22 17:17:58.551101 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:58.551063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:17:58.554429 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:58.554037 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcfpj\"" Jul 22 17:17:58.554429 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:58.554239 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 17:17:58.554642 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:58.554474 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 17:17:59.833055 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:17:59.832979 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4vh4" event={"ID":"f196aa45-596e-456e-b5a8-78883e5afba0","Type":"ContainerStarted","Data":"9b79d2c6e39dbc06a8d7f5d0867856087cc589fff9c8506fa4dc720f58030129"} Jul 22 17:18:01.767441 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:01.767411 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vcp5l" Jul 22 17:18:04.850077 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.850004 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7frk7" event={"ID":"4c7e4c78-d1f7-402a-b9ac-422077891d51","Type":"ContainerStarted","Data":"d843a1cc350837017af6378d8f49a2edf1e94446647b6b5c2234bcd00983e26b"} Jul 22 17:18:04.852521 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.852252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c4vh4" event={"ID":"f196aa45-596e-456e-b5a8-78883e5afba0","Type":"ContainerStarted","Data":"5b4f76541296d99783e695705cacf94338f7fa44046cea3660955eceece19aa1"} Jul 22 17:18:04.852521 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.852310 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c4vh4" Jul 22 17:18:04.854274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.854247 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zffcd" event={"ID":"da17968e-0310-4555-9b44-a45a5fa124c8","Type":"ContainerStarted","Data":"a25aff419e7f002e30bfd862513e5fe06a034843c17f23f84f0485c34c25cd18"} Jul 22 17:18:04.865906 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.865779 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7frk7" podStartSLOduration=2.430618678 podStartE2EDuration="8.865759364s" totalImagesPullingTime="6.435140686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:04.865481531 +0000 UTC m=+64.881826758" watchObservedRunningTime="2026-07-22 17:18:04.865759364 +0000 UTC m=+64.882104594" Jul 22 17:18:04.880829 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:04.880728 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c4vh4" podStartSLOduration=6.689658999 podStartE2EDuration="8.880706215s" totalImagesPullingTime="2.191047216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:04.879772429 +0000 UTC m=+64.896117680" watchObservedRunningTime="2026-07-22 17:18:04.880706215 +0000 UTC m=+64.897051443" Jul 22 17:18:05.716200 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.716168 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p"] Jul 22 17:18:05.724041 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.724018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.727053 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.726992 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 17:18:05.727168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.727051 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 17:18:05.727168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.727002 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jkm99\"" Jul 22 17:18:05.727168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.727067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 17:18:05.727168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.727061 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 17:18:05.727168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.727002 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 17:18:05.730526 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.730473 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p"] Jul 22 17:18:05.792266 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.792231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.792435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.792365 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvl8r\" (UniqueName: \"kubernetes.io/projected/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-kube-api-access-dvl8r\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.792501 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.792437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.792501 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.792467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.892890 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.892849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.893374 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.892900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.893374 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.892941 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.893374 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.893050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvl8r\" (UniqueName: \"kubernetes.io/projected/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-kube-api-access-dvl8r\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.893374 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:05.893059 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 22 17:18:05.893374 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:05.893152 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls podName:a3359d6a-4a12-427a-b8c4-7885d80ad2fc nodeName:}" failed. No retries permitted until 2026-07-22 17:18:06.393129128 +0000 UTC m=+66.409474353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-j5q7p" (UID: "a3359d6a-4a12-427a-b8c4-7885d80ad2fc") : secret "prometheus-operator-tls" not found Jul 22 17:18:05.893625 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.893575 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.895762 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.895736 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:05.903203 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:05.903180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvl8r\" (UniqueName: \"kubernetes.io/projected/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-kube-api-access-dvl8r\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:06.196344 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.196308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:18:06.196538 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.196358 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:18:06.198809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.198778 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 17:18:06.198968 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.198844 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 17:18:06.208799 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.208774 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 17:18:06.209224 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.209190 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42dbc1c-eaaf-44db-a51e-50877be12332-original-pull-secret\") pod \"global-pull-secret-syncer-tcq4h\" (UID: \"d42dbc1c-eaaf-44db-a51e-50877be12332\") " pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:18:06.220300 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.220273 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpskg\" (UniqueName: \"kubernetes.io/projected/6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e-kube-api-access-gpskg\") pod \"network-check-target-sr8m6\" (UID: \"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e\") " pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:18:06.265234 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.265188 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcq4h" Jul 22 17:18:06.297755 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.297725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:18:06.299912 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.299888 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 17:18:06.311240 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.311205 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9de728b-83a2-464e-be35-04d26c6a8c60-metrics-certs\") pod \"network-metrics-daemon-rvfvp\" (UID: \"b9de728b-83a2-464e-be35-04d26c6a8c60\") " pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:18:06.366714 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.366683 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcfpj\"" Jul 22 17:18:06.375394 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.375366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:18:06.399112 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.399079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:06.401495 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.401471 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a3359d6a-4a12-427a-b8c4-7885d80ad2fc-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-j5q7p\" (UID: \"a3359d6a-4a12-427a-b8c4-7885d80ad2fc\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:06.562721 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.562644 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvlz4\"" Jul 22 17:18:06.571313 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.571280 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvfvp" Jul 22 17:18:06.635467 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:06.635425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" Jul 22 17:18:07.421514 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.421483 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sr8m6"] Jul 22 17:18:07.425791 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:07.425694 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd9e1e9_feae_4e9c_aa4c_61d9bdb4b48e.slice/crio-5feecc293406d9808e16659ab5b954cd007f4cf88560c7c3fd54528cfcff7cde WatchSource:0}: Error finding container 5feecc293406d9808e16659ab5b954cd007f4cf88560c7c3fd54528cfcff7cde: Status 404 returned error can't find the container with id 5feecc293406d9808e16659ab5b954cd007f4cf88560c7c3fd54528cfcff7cde Jul 22 17:18:07.640080 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.640009 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvfvp"] Jul 22 17:18:07.643353 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:07.643319 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9de728b_83a2_464e_be35_04d26c6a8c60.slice/crio-53de34b3875f318841b3eb20ca0ced6e6574617a26a6496a7962ba618ef55de3 WatchSource:0}: Error finding container 53de34b3875f318841b3eb20ca0ced6e6574617a26a6496a7962ba618ef55de3: Status 404 returned error can't find the container with id 53de34b3875f318841b3eb20ca0ced6e6574617a26a6496a7962ba618ef55de3 Jul 22 17:18:07.644629 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.644606 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcq4h"] Jul 22 17:18:07.645440 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.645422 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p"] Jul 22 17:18:07.646775 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:07.646751 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3359d6a_4a12_427a_b8c4_7885d80ad2fc.slice/crio-a19316aac14e8c08247975af3f198d6ad9bd1c61057e8b2ef08036d194019a18 WatchSource:0}: Error finding container a19316aac14e8c08247975af3f198d6ad9bd1c61057e8b2ef08036d194019a18: Status 404 returned error can't find the container with id a19316aac14e8c08247975af3f198d6ad9bd1c61057e8b2ef08036d194019a18 Jul 22 17:18:07.647443 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:07.647411 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42dbc1c_eaaf_44db_a51e_50877be12332.slice/crio-afd61189aa029e9ab3640695af50d688e6159c009659094b37d98dfdbb2056a5 WatchSource:0}: Error finding container afd61189aa029e9ab3640695af50d688e6159c009659094b37d98dfdbb2056a5: Status 404 returned error can't find the container with id afd61189aa029e9ab3640695af50d688e6159c009659094b37d98dfdbb2056a5 Jul 22 17:18:07.866567 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.866506 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" event={"ID":"a3359d6a-4a12-427a-b8c4-7885d80ad2fc","Type":"ContainerStarted","Data":"a19316aac14e8c08247975af3f198d6ad9bd1c61057e8b2ef08036d194019a18"} Jul 22 17:18:07.867845 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.867818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sr8m6" event={"ID":"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e","Type":"ContainerStarted","Data":"5feecc293406d9808e16659ab5b954cd007f4cf88560c7c3fd54528cfcff7cde"} Jul 22 17:18:07.869842 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.869818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zffcd" event={"ID":"da17968e-0310-4555-9b44-a45a5fa124c8","Type":"ContainerStarted","Data":"22b58fd1fa590291c557e682c94a85c135281d02938d119747e7b2ebf2136e1b"} Jul 22 17:18:07.871106 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.871082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tcq4h" event={"ID":"d42dbc1c-eaaf-44db-a51e-50877be12332","Type":"ContainerStarted","Data":"afd61189aa029e9ab3640695af50d688e6159c009659094b37d98dfdbb2056a5"} Jul 22 17:18:07.872353 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:07.872326 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvfvp" event={"ID":"b9de728b-83a2-464e-be35-04d26c6a8c60","Type":"ContainerStarted","Data":"53de34b3875f318841b3eb20ca0ced6e6574617a26a6496a7962ba618ef55de3"} Jul 22 17:18:10.887444 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:10.887389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" event={"ID":"a3359d6a-4a12-427a-b8c4-7885d80ad2fc","Type":"ContainerStarted","Data":"3ac0011143b108f1242c8ee95eeae23db8a7da388cec5a7d7576b281e745a3d1"} Jul 22 17:18:10.889688 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:10.889658 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvfvp" event={"ID":"b9de728b-83a2-464e-be35-04d26c6a8c60","Type":"ContainerStarted","Data":"c7ab34d97c9261579e17a6d41eec064659a1cfc76d8f852fab55a528d0395742"} Jul 22 17:18:11.861175 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:11.861141 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c4vh4" Jul 22 17:18:14.905978 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.905911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvfvp" event={"ID":"b9de728b-83a2-464e-be35-04d26c6a8c60","Type":"ContainerStarted","Data":"d9c0fddb01c2b4c35fa33dcebcfb6ac4805c63fc455af63ab44b3b00d7e3d08a"} Jul 22 17:18:14.907622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.907596 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" event={"ID":"a3359d6a-4a12-427a-b8c4-7885d80ad2fc","Type":"ContainerStarted","Data":"1ae841d905b2877a19821e42ee134c9637372bf1b79ad491b362bb08a094a79d"} Jul 22 17:18:14.909021 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.908999 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sr8m6" event={"ID":"6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e","Type":"ContainerStarted","Data":"2e14cb6298f41fc0b8116dd569e349a4c6d9a033f6e94922d87fa98dcea17277"} Jul 22 17:18:14.909132 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.909123 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:18:14.912798 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.912776 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zffcd" event={"ID":"da17968e-0310-4555-9b44-a45a5fa124c8","Type":"ContainerStarted","Data":"732b6f62c8595c210ba3b2e34a18b82862b80ac539825172294b3833ca464158"} Jul 22 17:18:14.914555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.914536 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tcq4h" event={"ID":"d42dbc1c-eaaf-44db-a51e-50877be12332","Type":"ContainerStarted","Data":"665ab5405c9d71ddf405e71758ed13465534a42b38533b3ffbcd3ec96f978a42"} Jul 22 17:18:14.921934 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.921880 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rvfvp" podStartSLOduration=71.684064841 podStartE2EDuration="1m13.921864977s" totalImagesPullingTime="2.237800136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:14.921207583 +0000 UTC m=+74.937552811" watchObservedRunningTime="2026-07-22 17:18:14.921864977 +0000 UTC m=+74.938210207" Jul 22 17:18:14.938734 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.938698 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zffcd" podStartSLOduration=2.41872745 podStartE2EDuration="18.938685099s" totalImagesPullingTime="16.519957649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:14.937417937 +0000 UTC m=+74.953763164" watchObservedRunningTime="2026-07-22 17:18:14.938685099 +0000 UTC m=+74.955030325" Jul 22 17:18:14.954814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.954769 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-j5q7p" podStartSLOduration=7.716657922 podStartE2EDuration="9.954756305s" totalImagesPullingTime="2.238098383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:14.953841878 +0000 UTC m=+74.970187107" watchObservedRunningTime="2026-07-22 17:18:14.954756305 +0000 UTC m=+74.971101532" Jul 22 17:18:14.970021 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.969982 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tcq4h" podStartSLOduration=67.465769204 podStartE2EDuration="1m13.969964749s" totalImagesPullingTime="6.504195545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:14.969056533 +0000 UTC m=+74.985401783" watchObservedRunningTime="2026-07-22 17:18:14.969964749 +0000 UTC m=+74.986309976" Jul 22 17:18:14.987777 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:14.987735 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sr8m6" podStartSLOduration=67.261469737 podStartE2EDuration="1m13.987723322s" totalImagesPullingTime="6.726253585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:14.986991168 +0000 UTC m=+75.003336388" watchObservedRunningTime="2026-07-22 17:18:14.987723322 +0000 UTC m=+75.004068546" Jul 22 17:18:17.327497 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.327460 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r5blj"] Jul 22 17:18:17.330816 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.330795 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.334021 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.333987 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 17:18:17.334128 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.333990 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 17:18:17.334128 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.333990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-56pgq\"" Jul 22 17:18:17.334237 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.334018 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 17:18:17.334969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.334950 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nktgt"] Jul 22 17:18:17.338050 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.338025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.339908 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.339874 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f75mp\"" Jul 22 17:18:17.340046 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.339911 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 17:18:17.340046 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.339957 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 17:18:17.340046 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.340018 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 17:18:17.346392 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.346372 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r5blj"] Jul 22 17:18:17.491261 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491261 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-wtmp\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-metrics-client-ca\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491309 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-textfile\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-accelerators-collector-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491471 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8j72\" (UniqueName: \"kubernetes.io/projected/3640e25b-4694-464c-95f7-2dfd01e43a43-kube-api-access-r8j72\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvhm\" (UniqueName: \"kubernetes.io/projected/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-api-access-2kvhm\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491530 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abe89825-5816-4984-9ff0-bcda28c80bf6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491597 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-root\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.491670 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.491628 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-sys\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.592622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.592622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvhm\" (UniqueName: \"kubernetes.io/projected/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-api-access-2kvhm\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.592622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abe89825-5816-4984-9ff0-bcda28c80bf6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.592622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.592884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.592884 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:17.592723 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 17:18:17.592884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592788 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-root\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.592884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-sys\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.592884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592905 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-root\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:17.592982 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls podName:abe89825-5816-4984-9ff0-bcda28c80bf6 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:18.092959158 +0000 UTC m=+78.109304373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-r5blj" (UID: "abe89825-5816-4984-9ff0-bcda28c80bf6") : secret "kube-state-metrics-tls" not found Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.592914 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-wtmp\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-metrics-client-ca\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-textfile\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-accelerators-collector-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-wtmp\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/abe89825-5816-4984-9ff0-bcda28c80bf6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.593506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593247 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.593506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8j72\" (UniqueName: \"kubernetes.io/projected/3640e25b-4694-464c-95f7-2dfd01e43a43-kube-api-access-r8j72\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593464 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593520 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-textfile\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:17.593574 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593590 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3640e25b-4694-464c-95f7-2dfd01e43a43-sys\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:17.593628 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls podName:3640e25b-4694-464c-95f7-2dfd01e43a43 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:18.093607625 +0000 UTC m=+78.109952847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls") pod "node-exporter-nktgt" (UID: "3640e25b-4694-464c-95f7-2dfd01e43a43") : secret "node-exporter-tls" not found Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593656 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-metrics-client-ca\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.593774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.593699 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-accelerators-collector-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.594214 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.594192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.595232 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.595209 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:17.595325 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.595247 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.607940 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.607902 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvhm\" (UniqueName: \"kubernetes.io/projected/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-api-access-2kvhm\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:17.611543 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:17.611521 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8j72\" (UniqueName: \"kubernetes.io/projected/3640e25b-4694-464c-95f7-2dfd01e43a43-kube-api-access-r8j72\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:18.096707 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.096676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:18.096878 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.096718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:18.096878 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:18.096824 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 17:18:18.096979 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:18.096885 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls podName:abe89825-5816-4984-9ff0-bcda28c80bf6 nodeName:}" failed. No retries permitted until 2026-07-22 17:18:19.096871735 +0000 UTC m=+79.113216941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-r5blj" (UID: "abe89825-5816-4984-9ff0-bcda28c80bf6") : secret "kube-state-metrics-tls" not found Jul 22 17:18:18.098997 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.098974 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3640e25b-4694-464c-95f7-2dfd01e43a43-node-exporter-tls\") pod \"node-exporter-nktgt\" (UID: \"3640e25b-4694-464c-95f7-2dfd01e43a43\") " pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:18.249027 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.248991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nktgt" Jul 22 17:18:18.260897 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:18.260866 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3640e25b_4694_464c_95f7_2dfd01e43a43.slice/crio-89c91635dc12a9f15686a8f27c0fa71b4d75c5c91c3091b19a3f823cb4b378af WatchSource:0}: Error finding container 89c91635dc12a9f15686a8f27c0fa71b4d75c5c91c3091b19a3f823cb4b378af: Status 404 returned error can't find the container with id 89c91635dc12a9f15686a8f27c0fa71b4d75c5c91c3091b19a3f823cb4b378af Jul 22 17:18:18.270582 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.270560 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:18:18.275010 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.274989 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.280104 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.280085 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 17:18:18.280199 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.280159 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 17:18:18.280594 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.280577 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 17:18:18.280663 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.280579 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 17:18:18.280757 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.280739 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 17:18:18.281511 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.281490 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 17:18:18.281723 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.281706 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 17:18:18.281785 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.281756 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p4tv9\"" Jul 22 17:18:18.281936 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.281892 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 17:18:18.287761 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.287743 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 17:18:18.308240 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.308209 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:18:18.399331 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399331 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399331 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.399809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.399668 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvxgv\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500551 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500551 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500649 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvxgv\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.500795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501139 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.500954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501139 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.501007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501139 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.501035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501139 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.501063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501139 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.501101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.501966 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.501881 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.502100 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.502048 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.502222 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.502195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.503702 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.503654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.503975 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.503838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504302 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504258 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504446 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504421 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504453 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504460 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504617 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.504717 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.504700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.505676 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.505655 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.508605 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.508587 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvxgv\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv\") pod \"alertmanager-main-0\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.585100 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.585065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:18:18.729963 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.729917 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:18:18.731016 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:18.730979 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f48ec81_a234_44a4_8172_c212a35ba2a3.slice/crio-f83c198a60bd1e58f8cf2f8089da0e53e113e21f99016b6b5f9d4703bb112d89 WatchSource:0}: Error finding container f83c198a60bd1e58f8cf2f8089da0e53e113e21f99016b6b5f9d4703bb112d89: Status 404 returned error can't find the container with id f83c198a60bd1e58f8cf2f8089da0e53e113e21f99016b6b5f9d4703bb112d89 Jul 22 17:18:18.833579 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.833546 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-678b96d48c-zpfrz" Jul 22 17:18:18.929522 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.929443 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"f83c198a60bd1e58f8cf2f8089da0e53e113e21f99016b6b5f9d4703bb112d89"} Jul 22 17:18:18.930711 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:18.930684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nktgt" event={"ID":"3640e25b-4694-464c-95f7-2dfd01e43a43","Type":"ContainerStarted","Data":"89c91635dc12a9f15686a8f27c0fa71b4d75c5c91c3091b19a3f823cb4b378af"} Jul 22 17:18:19.106629 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.106594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:19.108892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.108857 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/abe89825-5816-4984-9ff0-bcda28c80bf6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r5blj\" (UID: \"abe89825-5816-4984-9ff0-bcda28c80bf6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:19.141404 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.141373 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" Jul 22 17:18:19.295091 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.295056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r5blj"] Jul 22 17:18:19.298664 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:19.298630 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe89825_5816_4984_9ff0_bcda28c80bf6.slice/crio-e55b4d0665e5b64128d348052548878655d1e47e52f31d8dac7a03b8827e9c36 WatchSource:0}: Error finding container e55b4d0665e5b64128d348052548878655d1e47e52f31d8dac7a03b8827e9c36: Status 404 returned error can't find the container with id e55b4d0665e5b64128d348052548878655d1e47e52f31d8dac7a03b8827e9c36 Jul 22 17:18:19.936109 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.936082 2582 generic.go:356] "Generic (PLEG): container finished" podID="3640e25b-4694-464c-95f7-2dfd01e43a43" containerID="f4e39a0fe247aa21e3d54d3fc68ae3f4aab2e7e2e9a6b1bfbbb5ea55066b9434" exitCode=0 Jul 22 17:18:19.936457 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.936160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nktgt" event={"ID":"3640e25b-4694-464c-95f7-2dfd01e43a43","Type":"ContainerDied","Data":"f4e39a0fe247aa21e3d54d3fc68ae3f4aab2e7e2e9a6b1bfbbb5ea55066b9434"} Jul 22 17:18:19.937432 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.937406 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" event={"ID":"abe89825-5816-4984-9ff0-bcda28c80bf6","Type":"ContainerStarted","Data":"e55b4d0665e5b64128d348052548878655d1e47e52f31d8dac7a03b8827e9c36"} Jul 22 17:18:19.938934 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.938901 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402" exitCode=0 Jul 22 17:18:19.939015 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:19.938946 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402"} Jul 22 17:18:20.947086 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:20.947048 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nktgt" event={"ID":"3640e25b-4694-464c-95f7-2dfd01e43a43","Type":"ContainerStarted","Data":"71692f4c125f557fda9b9bedb360265b19b9f3c5a51df2ce5827095c86adf4b7"} Jul 22 17:18:20.947422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:20.947114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nktgt" event={"ID":"3640e25b-4694-464c-95f7-2dfd01e43a43","Type":"ContainerStarted","Data":"20714512dbb9d528317e69f3d13e50d72d38377747c532a940f8c0cfd5bbb214"} Jul 22 17:18:20.965728 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:20.965686 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nktgt" podStartSLOduration=2.986605147 podStartE2EDuration="3.965668328s" totalImagesPullingTime="907.074129ms" totalInitContainerRuntime="71.989052ms" isStatefulPod=true podCreationTimestamp="2026-07-22 17:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:20.964362631 +0000 UTC m=+80.980707858" watchObservedRunningTime="2026-07-22 17:18:20.965668328 +0000 UTC m=+80.982013555" Jul 22 17:18:21.881192 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.881167 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8"] Jul 22 17:18:21.885372 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.885353 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:21.887341 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.887322 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xw8mx\"" Jul 22 17:18:21.887444 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.887320 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 17:18:21.893565 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.893545 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8"] Jul 22 17:18:21.953057 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.953020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" event={"ID":"abe89825-5816-4984-9ff0-bcda28c80bf6","Type":"ContainerStarted","Data":"1535b0c1c989419f91e861eb28ce1bff1367b692594f6a3eedd379d5ca84fbc2"} Jul 22 17:18:21.953467 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.953089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" event={"ID":"abe89825-5816-4984-9ff0-bcda28c80bf6","Type":"ContainerStarted","Data":"593360354b19fbea572464b4db58f4c5b0dda0370170a154d8bd27b66a0b1d40"} Jul 22 17:18:21.953467 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.953116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" event={"ID":"abe89825-5816-4984-9ff0-bcda28c80bf6","Type":"ContainerStarted","Data":"4e5d65617d08920dd4c7ebaff528c6b8e7459b4715b62872377f89cd971cae35"} Jul 22 17:18:21.956048 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.956025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48"} Jul 22 17:18:21.956158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.956077 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66"} Jul 22 17:18:21.956158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.956103 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db"} Jul 22 17:18:21.956158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.956125 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b"} Jul 22 17:18:21.956158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.956148 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d"} Jul 22 17:18:21.974336 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:21.972778 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-r5blj" podStartSLOduration=3.340702554 podStartE2EDuration="4.972759268s" totalImagesPullingTime="1.632056714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:21.971697336 +0000 UTC m=+81.988042562" watchObservedRunningTime="2026-07-22 17:18:21.972759268 +0000 UTC m=+81.989104494" Jul 22 17:18:22.032517 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.032481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.032646 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.032521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-287g9\" (UniqueName: \"kubernetes.io/projected/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-kube-api-access-287g9\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.133775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.133635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.133964 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.133901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-287g9\" (UniqueName: \"kubernetes.io/projected/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-kube-api-access-287g9\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.134046 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:22.133981 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 17:18:22.134096 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:18:22.134053 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert podName:1d8018fe-6db7-48c1-ad2e-28695dd0b24d nodeName:}" failed. No retries permitted until 2026-07-22 17:18:22.634032316 +0000 UTC m=+82.650377534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-qf6l8" (UID: "1d8018fe-6db7-48c1-ad2e-28695dd0b24d") : secret "monitoring-plugin-cert" not found Jul 22 17:18:22.144686 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.144654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-287g9\" (UniqueName: \"kubernetes.io/projected/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-kube-api-access-287g9\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.637964 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.637912 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.640528 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.640492 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d8018fe-6db7-48c1-ad2e-28695dd0b24d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-qf6l8\" (UID: \"1d8018fe-6db7-48c1-ad2e-28695dd0b24d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:22.794449 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:22.794417 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:23.049182 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:23.049160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8"] Jul 22 17:18:23.051482 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:23.051455 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8018fe_6db7_48c1_ad2e_28695dd0b24d.slice/crio-43ecbcaadea4b7d793f19500b0646e05d3041ebeb9c2a312bf59faf25197564b WatchSource:0}: Error finding container 43ecbcaadea4b7d793f19500b0646e05d3041ebeb9c2a312bf59faf25197564b: Status 404 returned error can't find the container with id 43ecbcaadea4b7d793f19500b0646e05d3041ebeb9c2a312bf59faf25197564b Jul 22 17:18:23.972939 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:23.972891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerStarted","Data":"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c"} Jul 22 17:18:23.974165 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:23.974142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" event={"ID":"1d8018fe-6db7-48c1-ad2e-28695dd0b24d","Type":"ContainerStarted","Data":"43ecbcaadea4b7d793f19500b0646e05d3041ebeb9c2a312bf59faf25197564b"} Jul 22 17:18:24.008303 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:24.008245 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.163116885 podStartE2EDuration="6.008225184s" totalImagesPullingTime="3.830346568s" totalInitContainerRuntime="14.761731ms" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:24.006229421 +0000 UTC m=+84.022574648" watchObservedRunningTime="2026-07-22 17:18:24.008225184 +0000 UTC m=+84.024570413" Jul 22 17:18:24.979247 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:24.979216 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" event={"ID":"1d8018fe-6db7-48c1-ad2e-28695dd0b24d","Type":"ContainerStarted","Data":"94c19abcb1fab86bcc913338a4258bc35b8ea4fe1370983f86955c3000eb1a80"} Jul 22 17:18:24.979671 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:24.979388 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:24.984408 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:24.984388 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" Jul 22 17:18:25.011249 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:25.011199 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-qf6l8" podStartSLOduration=2.5422814110000003 podStartE2EDuration="4.011184123s" totalImagesPullingTime="1.468902712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:25.011016235 +0000 UTC m=+85.027361462" watchObservedRunningTime="2026-07-22 17:18:25.011184123 +0000 UTC m=+85.027529350" Jul 22 17:18:27.679914 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.679875 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:18:27.683268 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.683246 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.685219 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685195 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 17:18:27.685318 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685217 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 17:18:27.685887 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685839 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 17:18:27.686002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685882 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 17:18:27.686002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685906 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gnm9b\"" Jul 22 17:18:27.686002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685866 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 17:18:27.686002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.685988 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 17:18:27.686196 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.686005 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 17:18:27.692528 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.692509 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 17:18:27.695726 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.695704 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:18:27.779700 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779612 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779700 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp4wp\" (UniqueName: \"kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779740 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.779969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.779934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.880979 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.880939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.880990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp4wp\" (UniqueName: \"kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881023 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881785 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.881809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.882028 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.882028 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.881886 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.883557 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.883536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.883646 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.883627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.891709 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.891687 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp4wp\" (UniqueName: \"kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp\") pod \"console-745d5f476-2jh7j\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:27.992584 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:27.992542 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:28.128833 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:28.128706 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:18:28.130588 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:18:28.130562 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e5a7bb_85ac_483f_861d_2a2ced4e7607.slice/crio-a464f2c73ce69f9e59d000a00c594f212878dab126a8f11f6243720dbad6e80f WatchSource:0}: Error finding container a464f2c73ce69f9e59d000a00c594f212878dab126a8f11f6243720dbad6e80f: Status 404 returned error can't find the container with id a464f2c73ce69f9e59d000a00c594f212878dab126a8f11f6243720dbad6e80f Jul 22 17:18:28.995162 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:28.995119 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745d5f476-2jh7j" event={"ID":"20e5a7bb-85ac-483f-861d-2a2ced4e7607","Type":"ContainerStarted","Data":"a464f2c73ce69f9e59d000a00c594f212878dab126a8f11f6243720dbad6e80f"} Jul 22 17:18:32.008977 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:32.008938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745d5f476-2jh7j" event={"ID":"20e5a7bb-85ac-483f-861d-2a2ced4e7607","Type":"ContainerStarted","Data":"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409"} Jul 22 17:18:32.027730 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:32.027687 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745d5f476-2jh7j" podStartSLOduration=2.033214916 podStartE2EDuration="5.027672175s" totalImagesPullingTime="2.994457259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:18:32.026654681 +0000 UTC m=+92.042999910" watchObservedRunningTime="2026-07-22 17:18:32.027672175 +0000 UTC m=+92.044017400" Jul 22 17:18:37.992884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:37.992843 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:37.993377 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:37.993186 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:37.997739 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:37.997716 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:38.032356 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:38.032331 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:18:45.921774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:18:45.921741 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sr8m6" Jul 22 17:19:37.713847 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.713811 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:37.714384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714200 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="alertmanager" containerID="cri-o://f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" gracePeriod=120 Jul 22 17:19:37.714384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714255 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-metric" containerID="cri-o://f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" gracePeriod=120 Jul 22 17:19:37.714384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714270 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="prom-label-proxy" containerID="cri-o://629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" gracePeriod=120 Jul 22 17:19:37.714384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714314 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-web" containerID="cri-o://dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" gracePeriod=120 Jul 22 17:19:37.714384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714315 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy" containerID="cri-o://df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" gracePeriod=120 Jul 22 17:19:37.714613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:37.714333 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="config-reloader" containerID="cri-o://0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" gracePeriod=120 Jul 22 17:19:38.241130 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241098 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" exitCode=0 Jul 22 17:19:38.241130 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241125 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" exitCode=0 Jul 22 17:19:38.241130 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241134 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" exitCode=0 Jul 22 17:19:38.241369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241142 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" exitCode=0 Jul 22 17:19:38.241369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c"} Jul 22 17:19:38.241369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241224 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66"} Jul 22 17:19:38.241369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b"} Jul 22 17:19:38.241369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.241276 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d"} Jul 22 17:19:38.951884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:38.951859 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.044087 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044001 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044087 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044093 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044225 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044257 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044285 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044311 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044314 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044335 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044368 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044392 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvxgv\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044439 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044472 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044498 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8f48ec81-a234-44a4-8172-c212a35ba2a3\" (UID: \"8f48ec81-a234-44a4-8172-c212a35ba2a3\") " Jul 22 17:19:39.044880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044616 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:39.044880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044761 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-main-db\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.044880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.044781 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-metrics-client-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.045460 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.045207 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:19:39.046916 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.046871 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out" (OuterVolumeSpecName: "config-out") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:19:39.047020 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.046964 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.047211 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047158 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.047211 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047170 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.047349 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047244 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.047405 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047367 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv" (OuterVolumeSpecName: "kube-api-access-jvxgv") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "kube-api-access-jvxgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:19:39.047552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047532 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume" (OuterVolumeSpecName: "config-volume") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.047619 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.047563 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:19:39.052654 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.052625 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.058098 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.058075 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config" (OuterVolumeSpecName: "web-config") pod "8f48ec81-a234-44a4-8172-c212a35ba2a3" (UID: "8f48ec81-a234-44a4-8172-c212a35ba2a3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:19:39.145633 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145597 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-main-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145633 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145626 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-tls-assets\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145633 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145635 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f48ec81-a234-44a4-8172-c212a35ba2a3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145645 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-volume\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145710 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvxgv\" (UniqueName: \"kubernetes.io/projected/8f48ec81-a234-44a4-8172-c212a35ba2a3-kube-api-access-jvxgv\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145741 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-web-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145762 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-cluster-tls-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145777 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145791 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f48ec81-a234-44a4-8172-c212a35ba2a3-config-out\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145806 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.145868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.145819 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f48ec81-a234-44a4-8172-c212a35ba2a3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:19:39.247319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247291 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" exitCode=0 Jul 22 17:19:39.247319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247314 2582 generic.go:356] "Generic (PLEG): container finished" podID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerID="dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" exitCode=0 Jul 22 17:19:39.247491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48"} Jul 22 17:19:39.247491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247370 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.247491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247404 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db"} Jul 22 17:19:39.247491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247431 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f48ec81-a234-44a4-8172-c212a35ba2a3","Type":"ContainerDied","Data":"f83c198a60bd1e58f8cf2f8089da0e53e113e21f99016b6b5f9d4703bb112d89"} Jul 22 17:19:39.247491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.247459 2582 scope.go:117] "RemoveContainer" containerID="629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" Jul 22 17:19:39.255613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.255589 2582 scope.go:117] "RemoveContainer" containerID="f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" Jul 22 17:19:39.262416 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.262396 2582 scope.go:117] "RemoveContainer" containerID="df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" Jul 22 17:19:39.268576 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.268556 2582 scope.go:117] "RemoveContainer" containerID="dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" Jul 22 17:19:39.270985 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.270954 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:39.277029 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.277009 2582 scope.go:117] "RemoveContainer" containerID="0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" Jul 22 17:19:39.279311 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.279286 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:39.284141 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.284124 2582 scope.go:117] "RemoveContainer" containerID="f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" Jul 22 17:19:39.290561 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.290535 2582 scope.go:117] "RemoveContainer" containerID="667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402" Jul 22 17:19:39.296860 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.296843 2582 scope.go:117] "RemoveContainer" containerID="629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" Jul 22 17:19:39.297153 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.297132 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c\": container with ID starting with 629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c not found: ID does not exist" containerID="629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" Jul 22 17:19:39.297227 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297160 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c"} err="failed to get container status \"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c\": rpc error: code = NotFound desc = could not find container \"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c\": container with ID starting with 629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c not found: ID does not exist" Jul 22 17:19:39.297227 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297199 2582 scope.go:117] "RemoveContainer" containerID="f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" Jul 22 17:19:39.297519 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.297438 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48\": container with ID starting with f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48 not found: ID does not exist" containerID="f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" Jul 22 17:19:39.297519 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297469 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48"} err="failed to get container status \"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48\": rpc error: code = NotFound desc = could not find container \"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48\": container with ID starting with f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48 not found: ID does not exist" Jul 22 17:19:39.297519 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297490 2582 scope.go:117] "RemoveContainer" containerID="df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" Jul 22 17:19:39.297778 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.297758 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66\": container with ID starting with df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66 not found: ID does not exist" containerID="df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" Jul 22 17:19:39.297814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297785 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66"} err="failed to get container status \"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66\": rpc error: code = NotFound desc = could not find container \"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66\": container with ID starting with df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66 not found: ID does not exist" Jul 22 17:19:39.297814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.297801 2582 scope.go:117] "RemoveContainer" containerID="dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" Jul 22 17:19:39.298065 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.298045 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db\": container with ID starting with dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db not found: ID does not exist" containerID="dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" Jul 22 17:19:39.298116 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298068 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db"} err="failed to get container status \"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db\": rpc error: code = NotFound desc = could not find container \"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db\": container with ID starting with dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db not found: ID does not exist" Jul 22 17:19:39.298116 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298082 2582 scope.go:117] "RemoveContainer" containerID="0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" Jul 22 17:19:39.298301 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.298287 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b\": container with ID starting with 0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b not found: ID does not exist" containerID="0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" Jul 22 17:19:39.298347 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298304 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b"} err="failed to get container status \"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b\": rpc error: code = NotFound desc = could not find container \"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b\": container with ID starting with 0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b not found: ID does not exist" Jul 22 17:19:39.298347 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298315 2582 scope.go:117] "RemoveContainer" containerID="f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" Jul 22 17:19:39.298537 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.298519 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d\": container with ID starting with f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d not found: ID does not exist" containerID="f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" Jul 22 17:19:39.298575 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298542 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d"} err="failed to get container status \"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d\": rpc error: code = NotFound desc = could not find container \"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d\": container with ID starting with f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d not found: ID does not exist" Jul 22 17:19:39.298575 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298558 2582 scope.go:117] "RemoveContainer" containerID="667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402" Jul 22 17:19:39.298781 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:19:39.298762 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402\": container with ID starting with 667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402 not found: ID does not exist" containerID="667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402" Jul 22 17:19:39.298853 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298785 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402"} err="failed to get container status \"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402\": rpc error: code = NotFound desc = could not find container \"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402\": container with ID starting with 667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402 not found: ID does not exist" Jul 22 17:19:39.298853 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298800 2582 scope.go:117] "RemoveContainer" containerID="629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c" Jul 22 17:19:39.299013 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.298993 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c"} err="failed to get container status \"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c\": rpc error: code = NotFound desc = could not find container \"629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c\": container with ID starting with 629041f7203fd50f7cb28590c4cc41f3fd19f28ac6c2f1d71a5aa6a9e2a5390c not found: ID does not exist" Jul 22 17:19:39.299054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299014 2582 scope.go:117] "RemoveContainer" containerID="f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48" Jul 22 17:19:39.299193 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299176 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48"} err="failed to get container status \"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48\": rpc error: code = NotFound desc = could not find container \"f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48\": container with ID starting with f11273328bf9e27b746e97f3d2bd790ddf93925cf2c0a9694d085c9fc81c2d48 not found: ID does not exist" Jul 22 17:19:39.299241 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299194 2582 scope.go:117] "RemoveContainer" containerID="df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66" Jul 22 17:19:39.299400 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299385 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66"} err="failed to get container status \"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66\": rpc error: code = NotFound desc = could not find container \"df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66\": container with ID starting with df861ca2c1258751ea5433726409c29199eb0ee1ceec2b4a5ff5841dee1ebe66 not found: ID does not exist" Jul 22 17:19:39.299450 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299401 2582 scope.go:117] "RemoveContainer" containerID="dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db" Jul 22 17:19:39.299564 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299548 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db"} err="failed to get container status \"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db\": rpc error: code = NotFound desc = could not find container \"dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db\": container with ID starting with dbcf5cabb3ed0ddfa5210f85aba50bf59f0f9b132f493dcfd732f18918d1d8db not found: ID does not exist" Jul 22 17:19:39.299600 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299564 2582 scope.go:117] "RemoveContainer" containerID="0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b" Jul 22 17:19:39.299733 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299719 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b"} err="failed to get container status \"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b\": rpc error: code = NotFound desc = could not find container \"0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b\": container with ID starting with 0034c5d8ff5228c912fada20f307368c61ccadf4b60aa6020ae32fd8bff6bc4b not found: ID does not exist" Jul 22 17:19:39.299776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299733 2582 scope.go:117] "RemoveContainer" containerID="f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d" Jul 22 17:19:39.299874 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299859 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d"} err="failed to get container status \"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d\": rpc error: code = NotFound desc = could not find container \"f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d\": container with ID starting with f87bbe8b3d82ea6de75abd833f881d0dc4a35de3586dad6a51a7f13a35e4748d not found: ID does not exist" Jul 22 17:19:39.299911 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.299883 2582 scope.go:117] "RemoveContainer" containerID="667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402" Jul 22 17:19:39.300084 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.300069 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402"} err="failed to get container status \"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402\": rpc error: code = NotFound desc = could not find container \"667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402\": container with ID starting with 667369b1730fc6cec136d0a696c5c23aae86877915c936f5ad3f1c0c8fa1b402 not found: ID does not exist" Jul 22 17:19:39.307172 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307153 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:39.307398 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307387 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="init-config-reloader" Jul 22 17:19:39.307435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307400 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="init-config-reloader" Jul 22 17:19:39.307435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307410 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-metric" Jul 22 17:19:39.307435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307416 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-metric" Jul 22 17:19:39.307435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307422 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="prom-label-proxy" Jul 22 17:19:39.307435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307427 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="prom-label-proxy" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307442 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="alertmanager" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307449 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="alertmanager" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307454 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="config-reloader" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307459 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="config-reloader" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307464 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-web" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307469 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-web" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307474 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307478 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307517 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="alertmanager" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307524 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-metric" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307531 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy-web" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307535 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="kube-rbac-proxy" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307541 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="prom-label-proxy" Jul 22 17:19:39.307599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.307548 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" containerName="config-reloader" Jul 22 17:19:39.310076 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.310061 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.312146 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312128 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 22 17:19:39.312399 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312385 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 22 17:19:39.312480 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312409 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p4tv9\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312626 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312637 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312626 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 22 17:19:39.312744 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.312645 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 22 17:19:39.319164 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.319143 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 22 17:19:39.326415 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.326394 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:39.347432 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347408 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347435 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347497 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhx6\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-kube-api-access-dnhx6\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347560 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347683 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347662 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.347848 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.347745 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448654 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.448810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449137 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.448810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhx6\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-kube-api-access-dnhx6\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449245 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449557 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.449693 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449670 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.450220 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.449852 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8a94a4-8127-4474-97a3-31ffb9965b37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.451719 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.451694 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452038 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452010 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452038 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452031 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452170 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452047 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452170 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452144 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452271 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8a94a4-8127-4474-97a3-31ffb9965b37-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452431 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.452487 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.452473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.453725 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.453708 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8a94a4-8127-4474-97a3-31ffb9965b37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.457148 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.457126 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhx6\" (UniqueName: \"kubernetes.io/projected/6f8a94a4-8127-4474-97a3-31ffb9965b37-kube-api-access-dnhx6\") pod \"alertmanager-main-0\" (UID: \"6f8a94a4-8127-4474-97a3-31ffb9965b37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.619435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.619353 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 22 17:19:39.774701 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:39.774599 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 22 17:19:39.776542 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:19:39.776508 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8a94a4_8127_4474_97a3_31ffb9965b37.slice/crio-2936ccad0956b68fc9dc9311728c0f473edc374291082cc4b4abe880e0365520 WatchSource:0}: Error finding container 2936ccad0956b68fc9dc9311728c0f473edc374291082cc4b4abe880e0365520: Status 404 returned error can't find the container with id 2936ccad0956b68fc9dc9311728c0f473edc374291082cc4b4abe880e0365520 Jul 22 17:19:40.251658 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.251628 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:19:40.253897 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.253873 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.254025 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.253982 2582 generic.go:356] "Generic (PLEG): container finished" podID="6f8a94a4-8127-4474-97a3-31ffb9965b37" containerID="d84768e55219a360bc2e0e335bf664d364554d4b000a93bf8663f75c7f32dd4e" exitCode=0 Jul 22 17:19:40.254025 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.254017 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerDied","Data":"d84768e55219a360bc2e0e335bf664d364554d4b000a93bf8663f75c7f32dd4e"} Jul 22 17:19:40.254114 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.254058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"2936ccad0956b68fc9dc9311728c0f473edc374291082cc4b4abe880e0365520"} Jul 22 17:19:40.269006 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.268979 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:19:40.355999 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.355973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356130 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356386 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356554 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356618 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356575 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356667 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.356667 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.356640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgj5\" (UniqueName: \"kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458000 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.457972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458000 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458048 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgj5\" (UniqueName: \"kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458846 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458815 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.458995 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.458972 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.459072 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.459051 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.459136 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.459112 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.460414 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.460393 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.460640 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.460619 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.465999 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.465953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgj5\" (UniqueName: \"kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5\") pod \"console-785dff694c-tpwxd\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.556732 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.556701 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f48ec81-a234-44a4-8172-c212a35ba2a3" path="/var/lib/kubelet/pods/8f48ec81-a234-44a4-8172-c212a35ba2a3/volumes" Jul 22 17:19:40.569851 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.569828 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:40.698645 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:40.698614 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:19:40.702568 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:19:40.702538 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8244dd68_989a_404c_8692_70079eca30b0.slice/crio-6d22ca40dd42e7c8abd75a21dee663ab22e0955bea6ce718cc63d2987597cb0a WatchSource:0}: Error finding container 6d22ca40dd42e7c8abd75a21dee663ab22e0955bea6ce718cc63d2987597cb0a: Status 404 returned error can't find the container with id 6d22ca40dd42e7c8abd75a21dee663ab22e0955bea6ce718cc63d2987597cb0a Jul 22 17:19:41.261880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.261843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"2992aa0c8732efe7d3cdc867e8dd991fe189b3afd5e705ecc4b533fd527d2e08"} Jul 22 17:19:41.262367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.261975 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"9b553f2fa047723b47607b159e398759aae581b6038a980fd63292ea37aa9d0f"} Jul 22 17:19:41.262367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.262014 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"1d8763f823d04d1dff48ca748da3682cf73e5bfc73a3d8e67589dd1b11ee36cc"} Jul 22 17:19:41.262367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.262038 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"7c760f0fda6c8bf6ddb82e49b12ded2d67227f3f2f241e0b657b6d99e7bb3616"} Jul 22 17:19:41.262367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.262072 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"0e87af6a28887c1abd49df0a2d4013f466e969acdacd5f8d2def5a93e4882bed"} Jul 22 17:19:41.262367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.262104 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8a94a4-8127-4474-97a3-31ffb9965b37","Type":"ContainerStarted","Data":"5d4fbe401d7feeeff241163cdc704defd0d996964fcf46edf6283423046e636f"} Jul 22 17:19:41.263389 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.263364 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785dff694c-tpwxd" event={"ID":"8244dd68-989a-404c-8692-70079eca30b0","Type":"ContainerStarted","Data":"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab"} Jul 22 17:19:41.263504 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.263401 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785dff694c-tpwxd" event={"ID":"8244dd68-989a-404c-8692-70079eca30b0","Type":"ContainerStarted","Data":"6d22ca40dd42e7c8abd75a21dee663ab22e0955bea6ce718cc63d2987597cb0a"} Jul 22 17:19:41.289090 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:41.289045 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.269804048 podStartE2EDuration="2.289030309s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.226261ms" isStatefulPod=false podCreationTimestamp="2026-07-22 17:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:19:41.287416853 +0000 UTC m=+161.303762079" watchObservedRunningTime="2026-07-22 17:19:41.289030309 +0000 UTC m=+161.305375526" Jul 22 17:19:50.570284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:50.570251 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:50.570723 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:50.570308 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:50.575126 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:50.575102 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:50.596528 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:50.596485 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-785dff694c-tpwxd" podStartSLOduration=10.596471876 podStartE2EDuration="10.596471876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:19:41.306350813 +0000 UTC m=+161.322696041" watchObservedRunningTime="2026-07-22 17:19:50.596471876 +0000 UTC m=+170.612817101" Jul 22 17:19:51.303079 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:51.303051 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:19:51.347760 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:19:51.347725 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:20:16.369555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.369497 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-745d5f476-2jh7j" podUID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" containerName="console" containerID="cri-o://bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409" gracePeriod=15 Jul 22 17:20:16.602861 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.602838 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:20:16.738553 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738525 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp4wp\" (UniqueName: \"kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738701 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738570 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738701 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738603 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738701 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738671 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738710 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738742 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.738817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.738767 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config\") pod \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\" (UID: \"20e5a7bb-85ac-483f-861d-2a2ced4e7607\") " Jul 22 17:20:16.739056 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.739024 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:20:16.739136 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.739095 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca" (OuterVolumeSpecName: "service-ca") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:20:16.739229 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.739144 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:20:16.739358 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.739319 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config" (OuterVolumeSpecName: "console-config") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:20:16.740863 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.740826 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:20:16.741032 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.740869 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:20:16.741032 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.740915 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp" (OuterVolumeSpecName: "kube-api-access-rp4wp") pod "20e5a7bb-85ac-483f-861d-2a2ced4e7607" (UID: "20e5a7bb-85ac-483f-861d-2a2ced4e7607"). InnerVolumeSpecName "kube-api-access-rp4wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:20:16.839457 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839430 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-trusted-ca-bundle\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839457 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839452 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-serving-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839461 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-service-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839470 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-oauth-serving-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839479 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-oauth-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839487 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e5a7bb-85ac-483f-861d-2a2ced4e7607-console-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:16.839586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:16.839495 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp4wp\" (UniqueName: \"kubernetes.io/projected/20e5a7bb-85ac-483f-861d-2a2ced4e7607-kube-api-access-rp4wp\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:20:17.392233 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.392203 2582 generic.go:356] "Generic (PLEG): container finished" podID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" containerID="bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409" exitCode=0 Jul 22 17:20:17.392630 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.392245 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745d5f476-2jh7j" Jul 22 17:20:17.392630 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.392290 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745d5f476-2jh7j" event={"ID":"20e5a7bb-85ac-483f-861d-2a2ced4e7607","Type":"ContainerDied","Data":"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409"} Jul 22 17:20:17.392630 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.392339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745d5f476-2jh7j" event={"ID":"20e5a7bb-85ac-483f-861d-2a2ced4e7607","Type":"ContainerDied","Data":"a464f2c73ce69f9e59d000a00c594f212878dab126a8f11f6243720dbad6e80f"} Jul 22 17:20:17.392630 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.392361 2582 scope.go:117] "RemoveContainer" containerID="bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409" Jul 22 17:20:17.401790 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.401773 2582 scope.go:117] "RemoveContainer" containerID="bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409" Jul 22 17:20:17.402100 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:20:17.402079 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409\": container with ID starting with bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409 not found: ID does not exist" containerID="bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409" Jul 22 17:20:17.402160 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.402112 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409"} err="failed to get container status \"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409\": rpc error: code = NotFound desc = could not find container \"bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409\": container with ID starting with bd16c30f5d844d59a7bbbe5dc8d7c3c34f9adcab81cff0b689611d8a06b6a409 not found: ID does not exist" Jul 22 17:20:17.411349 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.411323 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:20:17.415010 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:17.414991 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745d5f476-2jh7j"] Jul 22 17:20:18.554047 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:20:18.554014 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" path="/var/lib/kubelet/pods/20e5a7bb-85ac-483f-861d-2a2ced4e7607/volumes" Jul 22 17:22:00.378325 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:00.378292 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:22:00.381309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:00.381286 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 17:22:00.386937 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:00.386892 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:22:41.376135 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.376094 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:22:41.376578 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.376382 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" containerName="console" Jul 22 17:22:41.376578 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.376393 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" containerName="console" Jul 22 17:22:41.376578 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.376455 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e5a7bb-85ac-483f-861d-2a2ced4e7607" containerName="console" Jul 22 17:22:41.379462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.379442 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:41.381468 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.381427 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-lj6qf\"" Jul 22 17:22:41.381626 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.381520 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 22 17:22:41.381934 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.381907 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 22 17:22:41.396702 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.396672 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:22:41.483811 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.483765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bjc\" (UniqueName: \"kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc\") pod \"feast-operator-controller-manager-668c6cfddf-zkhqq\" (UID: \"9574cda0-e08d-4d39-b45a-839b3ef46448\") " pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:41.584203 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.584159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bjc\" (UniqueName: \"kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc\") pod \"feast-operator-controller-manager-668c6cfddf-zkhqq\" (UID: \"9574cda0-e08d-4d39-b45a-839b3ef46448\") " pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:41.592308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.592271 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bjc\" (UniqueName: \"kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc\") pod \"feast-operator-controller-manager-668c6cfddf-zkhqq\" (UID: \"9574cda0-e08d-4d39-b45a-839b3ef46448\") " pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:41.690309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.690199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:41.825956 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.825766 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:22:41.828773 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:22:41.828740 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9574cda0_e08d_4d39_b45a_839b3ef46448.slice/crio-68fbb8000ebd2a955d8fcb6084a97c95cfff0f35104fd2077718f71487197adf WatchSource:0}: Error finding container 68fbb8000ebd2a955d8fcb6084a97c95cfff0f35104fd2077718f71487197adf: Status 404 returned error can't find the container with id 68fbb8000ebd2a955d8fcb6084a97c95cfff0f35104fd2077718f71487197adf Jul 22 17:22:41.830765 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.830743 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:22:41.911413 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:41.911368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" event={"ID":"9574cda0-e08d-4d39-b45a-839b3ef46448","Type":"ContainerStarted","Data":"68fbb8000ebd2a955d8fcb6084a97c95cfff0f35104fd2077718f71487197adf"} Jul 22 17:22:44.925087 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:44.925050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" event={"ID":"9574cda0-e08d-4d39-b45a-839b3ef46448","Type":"ContainerStarted","Data":"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4"} Jul 22 17:22:44.925484 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:44.925126 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:22:44.944051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:44.943991 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" podStartSLOduration=1.554498174 podStartE2EDuration="3.943971018s" totalImagesPullingTime="2.389472844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:22:44.940801757 +0000 UTC m=+344.957146985" watchObservedRunningTime="2026-07-22 17:22:44.943971018 +0000 UTC m=+344.960316244" Jul 22 17:22:55.930940 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:22:55.930894 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:23:41.188860 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.188814 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65786f966b-ggbcr"] Jul 22 17:23:41.191895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.191872 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.207639 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.207609 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65786f966b-ggbcr"] Jul 22 17:23:41.257627 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-console-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.257627 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257635 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-service-ca\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.257856 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.257856 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-trusted-ca-bundle\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.257856 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-oauth-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.258039 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-oauth-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.258039 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.257988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxpq\" (UniqueName: \"kubernetes.io/projected/d582da68-e3d2-4723-a395-7ebf57d61813-kube-api-access-hvxpq\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.358989 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.358949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.358989 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.358995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-trusted-ca-bundle\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.359251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-oauth-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.359251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-oauth-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.359251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxpq\" (UniqueName: \"kubernetes.io/projected/d582da68-e3d2-4723-a395-7ebf57d61813-kube-api-access-hvxpq\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.359251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-console-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.359251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-service-ca\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.360021 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.359990 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-console-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.360153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.360034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-service-ca\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.360153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.360078 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-oauth-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.360153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.360104 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d582da68-e3d2-4723-a395-7ebf57d61813-trusted-ca-bundle\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.361679 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.361654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-serving-cert\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.361809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.361763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d582da68-e3d2-4723-a395-7ebf57d61813-console-oauth-config\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.368498 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.368467 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxpq\" (UniqueName: \"kubernetes.io/projected/d582da68-e3d2-4723-a395-7ebf57d61813-kube-api-access-hvxpq\") pod \"console-65786f966b-ggbcr\" (UID: \"d582da68-e3d2-4723-a395-7ebf57d61813\") " pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.501491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.501445 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:41.646248 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:41.646214 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65786f966b-ggbcr"] Jul 22 17:23:41.649418 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:23:41.649385 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd582da68_e3d2_4723_a395_7ebf57d61813.slice/crio-e6745a69a478780eb38c7f6cf139993f125735bec92fe729cf49641dc3bc7b40 WatchSource:0}: Error finding container e6745a69a478780eb38c7f6cf139993f125735bec92fe729cf49641dc3bc7b40: Status 404 returned error can't find the container with id e6745a69a478780eb38c7f6cf139993f125735bec92fe729cf49641dc3bc7b40 Jul 22 17:23:42.125733 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:42.125684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65786f966b-ggbcr" event={"ID":"d582da68-e3d2-4723-a395-7ebf57d61813","Type":"ContainerStarted","Data":"0419f5f1416246e62906473f438cc64df25a3ae374a2d9d56b636acb33c4e3dd"} Jul 22 17:23:42.125918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:42.125748 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65786f966b-ggbcr" event={"ID":"d582da68-e3d2-4723-a395-7ebf57d61813","Type":"ContainerStarted","Data":"e6745a69a478780eb38c7f6cf139993f125735bec92fe729cf49641dc3bc7b40"} Jul 22 17:23:42.144248 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:42.144187 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65786f966b-ggbcr" podStartSLOduration=1.144168109 podStartE2EDuration="1.144168109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:23:42.143460434 +0000 UTC m=+402.159805660" watchObservedRunningTime="2026-07-22 17:23:42.144168109 +0000 UTC m=+402.160513335" Jul 22 17:23:51.501661 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:51.501609 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:51.502116 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:51.501696 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:51.506769 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:51.506737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:52.164260 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:52.164230 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65786f966b-ggbcr" Jul 22 17:23:52.215848 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:23:52.215810 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:24:17.236827 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.236757 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-785dff694c-tpwxd" podUID="8244dd68-989a-404c-8692-70079eca30b0" containerName="console" containerID="cri-o://f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab" gracePeriod=15 Jul 22 17:24:17.480939 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.480890 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:24:17.567235 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567143 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567235 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567201 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sgj5\" (UniqueName: \"kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567235 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567230 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567474 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567260 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567474 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567320 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567474 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567358 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567474 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567377 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca\") pod \"8244dd68-989a-404c-8692-70079eca30b0\" (UID: \"8244dd68-989a-404c-8692-70079eca30b0\") " Jul 22 17:24:17.567678 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567574 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:24:17.567837 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567804 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:24:17.567911 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567837 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:24:17.567911 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.567847 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config" (OuterVolumeSpecName: "console-config") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:24:17.569585 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.569545 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:24:17.569585 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.569560 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5" (OuterVolumeSpecName: "kube-api-access-4sgj5") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "kube-api-access-4sgj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:24:17.569738 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.569597 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8244dd68-989a-404c-8692-70079eca30b0" (UID: "8244dd68-989a-404c-8692-70079eca30b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:24:17.668792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668737 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-console-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.668792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668781 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-oauth-config\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.668792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668791 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-service-ca\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.668792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668800 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-oauth-serving-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.668792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668809 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sgj5\" (UniqueName: \"kubernetes.io/projected/8244dd68-989a-404c-8692-70079eca30b0-kube-api-access-4sgj5\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.669124 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668819 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8244dd68-989a-404c-8692-70079eca30b0-console-serving-cert\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:17.669124 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:17.668827 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8244dd68-989a-404c-8692-70079eca30b0-trusted-ca-bundle\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:24:18.259724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.259690 2582 generic.go:356] "Generic (PLEG): container finished" podID="8244dd68-989a-404c-8692-70079eca30b0" containerID="f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab" exitCode=0 Jul 22 17:24:18.260259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.259738 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785dff694c-tpwxd" event={"ID":"8244dd68-989a-404c-8692-70079eca30b0","Type":"ContainerDied","Data":"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab"} Jul 22 17:24:18.260259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.259740 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-785dff694c-tpwxd" Jul 22 17:24:18.260259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.259776 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-785dff694c-tpwxd" event={"ID":"8244dd68-989a-404c-8692-70079eca30b0","Type":"ContainerDied","Data":"6d22ca40dd42e7c8abd75a21dee663ab22e0955bea6ce718cc63d2987597cb0a"} Jul 22 17:24:18.260259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.259796 2582 scope.go:117] "RemoveContainer" containerID="f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab" Jul 22 17:24:18.268128 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.268078 2582 scope.go:117] "RemoveContainer" containerID="f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab" Jul 22 17:24:18.268387 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:24:18.268364 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab\": container with ID starting with f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab not found: ID does not exist" containerID="f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab" Jul 22 17:24:18.268441 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.268396 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab"} err="failed to get container status \"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab\": rpc error: code = NotFound desc = could not find container \"f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab\": container with ID starting with f7345d6ce8cc510ffd67423623a78acda98051a00286e91b8794b670c58352ab not found: ID does not exist" Jul 22 17:24:18.279353 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.279321 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:24:18.283198 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.283171 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-785dff694c-tpwxd"] Jul 22 17:24:18.554642 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:24:18.554559 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8244dd68-989a-404c-8692-70079eca30b0" path="/var/lib/kubelet/pods/8244dd68-989a-404c-8692-70079eca30b0/volumes" Jul 22 17:27:00.402257 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:27:00.402220 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:27:00.408069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:27:00.408044 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:28:42.880709 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.880670 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:28:42.881231 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.881093 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8244dd68-989a-404c-8692-70079eca30b0" containerName="console" Jul 22 17:28:42.881231 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.881110 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8244dd68-989a-404c-8692-70079eca30b0" containerName="console" Jul 22 17:28:42.881231 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.881195 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8244dd68-989a-404c-8692-70079eca30b0" containerName="console" Jul 22 17:28:42.884323 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.884300 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:42.887983 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.887897 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-b2sbw\"" Jul 22 17:28:42.888140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.887897 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 22 17:28:42.888384 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.888369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 22 17:28:42.888717 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.888703 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 22 17:28:42.899080 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.899041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:28:42.993428 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.993389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:42.993615 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:42.993457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wff9k\" (UniqueName: \"kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.094823 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.094782 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.094966 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.094871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wff9k\" (UniqueName: \"kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.095208 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.095185 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.105026 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.104989 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wff9k\" (UniqueName: \"kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k\") pod \"postgres-864846d4f5-rsgtl\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.211476 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.211441 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:28:43.348616 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.348581 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:28:43.351721 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:28:43.351680 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87abf16c_8133_497d_8b02_8fe12ca5aaec.slice/crio-39208ec21ce6675209ab5448447a36b474c254a92f0b86dd0653024bd56032ea WatchSource:0}: Error finding container 39208ec21ce6675209ab5448447a36b474c254a92f0b86dd0653024bd56032ea: Status 404 returned error can't find the container with id 39208ec21ce6675209ab5448447a36b474c254a92f0b86dd0653024bd56032ea Jul 22 17:28:43.353607 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:43.353588 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:28:44.230342 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:44.230296 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rsgtl" event={"ID":"87abf16c-8133-497d-8b02-8fe12ca5aaec","Type":"ContainerStarted","Data":"39208ec21ce6675209ab5448447a36b474c254a92f0b86dd0653024bd56032ea"} Jul 22 17:28:50.256909 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:50.256867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rsgtl" event={"ID":"87abf16c-8133-497d-8b02-8fe12ca5aaec","Type":"ContainerStarted","Data":"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5"} Jul 22 17:28:50.273525 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:28:50.273457 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-rsgtl" podStartSLOduration=2.177367272 podStartE2EDuration="8.273439432s" totalImagesPullingTime="6.09607216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:28:50.272317288 +0000 UTC m=+710.288662516" watchObservedRunningTime="2026-07-22 17:28:50.273439432 +0000 UTC m=+710.289784696" Jul 22 17:29:20.387714 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.387667 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-wpjhp"] Jul 22 17:29:20.394527 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.394494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:20.396532 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.396502 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 22 17:29:20.396715 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.396569 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-lw9b4\"" Jul 22 17:29:20.397468 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.397443 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-wpjhp"] Jul 22 17:29:20.511484 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.511439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwth7\" (UniqueName: \"kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7\") pod \"feast-test-apply-wpjhp\" (UID: \"3291b1c0-2152-45e8-9506-eb84b0f3e11c\") " pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:20.612552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.612510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwth7\" (UniqueName: \"kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7\") pod \"feast-test-apply-wpjhp\" (UID: \"3291b1c0-2152-45e8-9506-eb84b0f3e11c\") " pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:20.621502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.621472 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwth7\" (UniqueName: \"kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7\") pod \"feast-test-apply-wpjhp\" (UID: \"3291b1c0-2152-45e8-9506-eb84b0f3e11c\") " pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:20.704444 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.704393 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:20.840316 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:20.840284 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-wpjhp"] Jul 22 17:29:20.843682 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:29:20.843643 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3291b1c0_2152_45e8_9506_eb84b0f3e11c.slice/crio-a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b WatchSource:0}: Error finding container a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b: Status 404 returned error can't find the container with id a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b Jul 22 17:29:21.373801 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:21.373751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerStarted","Data":"a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b"} Jul 22 17:29:26.398069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:26.398022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerStarted","Data":"3f6b667429b062c1afb9c066e4e846144caf890155c3e279e370f74096468496"} Jul 22 17:29:33.426529 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:33.426484 2582 generic.go:356] "Generic (PLEG): container finished" podID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerID="3f6b667429b062c1afb9c066e4e846144caf890155c3e279e370f74096468496" exitCode=0 Jul 22 17:29:33.426969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:33.426557 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerDied","Data":"3f6b667429b062c1afb9c066e4e846144caf890155c3e279e370f74096468496"} Jul 22 17:29:34.431734 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:34.431696 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerStarted","Data":"beec94f55b74a38e9d11bb8287ad58900521ad708bcbc13c4080c6fe26120b17"} Jul 22 17:29:34.447934 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:34.447858 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-wpjhp" podStartSLOduration=2.759630036 podStartE2EDuration="14.447840452s" totalImagesPullingTime="5.037726915s" totalInitContainerRuntime="6.650483501s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:29:34.44667709 +0000 UTC m=+754.463022336" watchObservedRunningTime="2026-07-22 17:29:34.447840452 +0000 UTC m=+754.464185719" Jul 22 17:29:43.470607 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:43.470565 2582 generic.go:356] "Generic (PLEG): container finished" podID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerID="beec94f55b74a38e9d11bb8287ad58900521ad708bcbc13c4080c6fe26120b17" exitCode=0 Jul 22 17:29:43.471049 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:43.470637 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerDied","Data":"beec94f55b74a38e9d11bb8287ad58900521ad708bcbc13c4080c6fe26120b17"} Jul 22 17:29:44.606340 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:44.606310 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:44.623854 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:44.623467 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwth7\" (UniqueName: \"kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7\") pod \"3291b1c0-2152-45e8-9506-eb84b0f3e11c\" (UID: \"3291b1c0-2152-45e8-9506-eb84b0f3e11c\") " Jul 22 17:29:44.626325 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:44.626289 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7" (OuterVolumeSpecName: "kube-api-access-lwth7") pod "3291b1c0-2152-45e8-9506-eb84b0f3e11c" (UID: "3291b1c0-2152-45e8-9506-eb84b0f3e11c"). InnerVolumeSpecName "kube-api-access-lwth7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:29:44.724793 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:44.724696 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwth7\" (UniqueName: \"kubernetes.io/projected/3291b1c0-2152-45e8-9506-eb84b0f3e11c-kube-api-access-lwth7\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:29:45.479774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:45.479735 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-wpjhp" event={"ID":"3291b1c0-2152-45e8-9506-eb84b0f3e11c","Type":"ContainerDied","Data":"a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b"} Jul 22 17:29:45.479774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:45.479762 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-wpjhp" Jul 22 17:29:45.479774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:45.479781 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4e319124bf65f2c2b2d7d7a8e02f3480791d0ab239327ad85601cad84c5c53b" Jul 22 17:29:45.654072 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:45.654040 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-wpjhp_3291b1c0-2152-45e8-9506-eb84b0f3e11c/feast-0/0.log" Jul 22 17:29:45.660098 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:29:45.660069 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-wpjhp_3291b1c0-2152-45e8-9506-eb84b0f3e11c/feast-1/0.log" Jul 22 17:30:24.359725 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.359603 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-wpjhp"] Jul 22 17:30:24.362643 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.362610 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-wpjhp"] Jul 22 17:30:24.369844 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.369808 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:30:24.370043 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.370016 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-rsgtl" podUID="87abf16c-8133-497d-8b02-8fe12ca5aaec" containerName="postgres" containerID="cri-o://1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5" gracePeriod=30 Jul 22 17:30:24.555260 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.555228 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" path="/var/lib/kubelet/pods/3291b1c0-2152-45e8-9506-eb84b0f3e11c/volumes" Jul 22 17:30:24.629502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.629467 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:30:24.633276 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.633243 2582 generic.go:356] "Generic (PLEG): container finished" podID="87abf16c-8133-497d-8b02-8fe12ca5aaec" containerID="1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5" exitCode=0 Jul 22 17:30:24.633276 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.633274 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rsgtl" Jul 22 17:30:24.633461 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.633322 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rsgtl" event={"ID":"87abf16c-8133-497d-8b02-8fe12ca5aaec","Type":"ContainerDied","Data":"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5"} Jul 22 17:30:24.633461 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.633371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rsgtl" event={"ID":"87abf16c-8133-497d-8b02-8fe12ca5aaec","Type":"ContainerDied","Data":"39208ec21ce6675209ab5448447a36b474c254a92f0b86dd0653024bd56032ea"} Jul 22 17:30:24.633461 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.633391 2582 scope.go:117] "RemoveContainer" containerID="1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5" Jul 22 17:30:24.642423 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.642393 2582 scope.go:117] "RemoveContainer" containerID="1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5" Jul 22 17:30:24.642803 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:30:24.642779 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5\": container with ID starting with 1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5 not found: ID does not exist" containerID="1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5" Jul 22 17:30:24.642903 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.642815 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5"} err="failed to get container status \"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5\": rpc error: code = NotFound desc = could not find container \"1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5\": container with ID starting with 1175a65d83b175361034e84715eab7fb3d979c8df5ebf82705a0d1a06d2d59d5 not found: ID does not exist" Jul 22 17:30:24.754814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.754778 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wff9k\" (UniqueName: \"kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k\") pod \"87abf16c-8133-497d-8b02-8fe12ca5aaec\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " Jul 22 17:30:24.754814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.754832 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata\") pod \"87abf16c-8133-497d-8b02-8fe12ca5aaec\" (UID: \"87abf16c-8133-497d-8b02-8fe12ca5aaec\") " Jul 22 17:30:24.757035 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.756999 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k" (OuterVolumeSpecName: "kube-api-access-wff9k") pod "87abf16c-8133-497d-8b02-8fe12ca5aaec" (UID: "87abf16c-8133-497d-8b02-8fe12ca5aaec"). InnerVolumeSpecName "kube-api-access-wff9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:30:24.784742 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.784700 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "87abf16c-8133-497d-8b02-8fe12ca5aaec" (UID: "87abf16c-8133-497d-8b02-8fe12ca5aaec"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:30:24.855806 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.855774 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wff9k\" (UniqueName: \"kubernetes.io/projected/87abf16c-8133-497d-8b02-8fe12ca5aaec-kube-api-access-wff9k\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:30:24.855806 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.855803 2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/87abf16c-8133-497d-8b02-8fe12ca5aaec-postgresdata\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:30:24.953104 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.953056 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:30:24.956724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:24.956697 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rsgtl"] Jul 22 17:30:26.553819 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:30:26.553778 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87abf16c-8133-497d-8b02-8fe12ca5aaec" path="/var/lib/kubelet/pods/87abf16c-8133-497d-8b02-8fe12ca5aaec/volumes" Jul 22 17:32:00.425847 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:00.425812 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:32:00.430316 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:00.430292 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:32:59.621336 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621287 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621632 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerName="feast-1" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621646 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerName="feast-1" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621657 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerName="feast-0" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621663 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerName="feast-0" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621677 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87abf16c-8133-497d-8b02-8fe12ca5aaec" containerName="postgres" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621682 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="87abf16c-8133-497d-8b02-8fe12ca5aaec" containerName="postgres" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621734 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3291b1c0-2152-45e8-9506-eb84b0f3e11c" containerName="feast-1" Jul 22 17:32:59.623810 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.621742 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="87abf16c-8133-497d-8b02-8fe12ca5aaec" containerName="postgres" Jul 22 17:32:59.624586 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.624568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.626760 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.626735 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jul 22 17:32:59.626917 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.626779 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jul 22 17:32:59.627148 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.627130 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jul 22 17:32:59.627234 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.627153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-hrkqc\"" Jul 22 17:32:59.629964 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.629938 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:32:59.698426 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.698379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.698426 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.698429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvb5\" (UniqueName: \"kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.799523 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.799476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.799523 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.799528 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knvb5\" (UniqueName: \"kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.799960 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.799906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.807816 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.807782 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvb5\" (UniqueName: \"kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5\") pod \"postgres-864846d4f5-t69b7\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:32:59.951994 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:32:59.951946 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:33:00.089550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:33:00.089507 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:33:00.092808 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:33:00.092772 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeaf0d0b_96be_4064_80cb_e3db8d64bce2.slice/crio-4f60ce3b099ff01c901de3e6c2e74f8e4ccc8930c4d0df351df13ca0c1bde4a7 WatchSource:0}: Error finding container 4f60ce3b099ff01c901de3e6c2e74f8e4ccc8930c4d0df351df13ca0c1bde4a7: Status 404 returned error can't find the container with id 4f60ce3b099ff01c901de3e6c2e74f8e4ccc8930c4d0df351df13ca0c1bde4a7 Jul 22 17:33:00.217495 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:33:00.217381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" event={"ID":"eeaf0d0b-96be-4064-80cb-e3db8d64bce2","Type":"ContainerStarted","Data":"a374d7e0fbcccb5f6fcfbe2ff903576d047a846b7d03d0d1b05e5272fcaf8960"} Jul 22 17:33:00.217495 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:33:00.217443 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" event={"ID":"eeaf0d0b-96be-4064-80cb-e3db8d64bce2","Type":"ContainerStarted","Data":"4f60ce3b099ff01c901de3e6c2e74f8e4ccc8930c4d0df351df13ca0c1bde4a7"} Jul 22 17:33:00.232404 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:33:00.232330 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" podStartSLOduration=1.232310424 podStartE2EDuration="1.232310424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:33:00.231716402 +0000 UTC m=+960.248061620" watchObservedRunningTime="2026-07-22 17:33:00.232310424 +0000 UTC m=+960.248655650" Jul 22 17:35:22.028431 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.028391 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:35:22.028982 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.028622 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" podUID="9574cda0-e08d-4d39-b45a-839b3ef46448" containerName="manager" containerID="cri-o://44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4" gracePeriod=10 Jul 22 17:35:22.319997 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.319968 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:35:22.501396 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.501345 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7bjc\" (UniqueName: \"kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc\") pod \"9574cda0-e08d-4d39-b45a-839b3ef46448\" (UID: \"9574cda0-e08d-4d39-b45a-839b3ef46448\") " Jul 22 17:35:22.503738 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.503702 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc" (OuterVolumeSpecName: "kube-api-access-c7bjc") pod "9574cda0-e08d-4d39-b45a-839b3ef46448" (UID: "9574cda0-e08d-4d39-b45a-839b3ef46448"). InnerVolumeSpecName "kube-api-access-c7bjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:35:22.602158 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.602123 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7bjc\" (UniqueName: \"kubernetes.io/projected/9574cda0-e08d-4d39-b45a-839b3ef46448-kube-api-access-c7bjc\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:35:22.758589 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.758544 2582 generic.go:356] "Generic (PLEG): container finished" podID="9574cda0-e08d-4d39-b45a-839b3ef46448" containerID="44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4" exitCode=0 Jul 22 17:35:22.758589 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.758593 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" Jul 22 17:35:22.758814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.758614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" event={"ID":"9574cda0-e08d-4d39-b45a-839b3ef46448","Type":"ContainerDied","Data":"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4"} Jul 22 17:35:22.758814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.758669 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq" event={"ID":"9574cda0-e08d-4d39-b45a-839b3ef46448","Type":"ContainerDied","Data":"68fbb8000ebd2a955d8fcb6084a97c95cfff0f35104fd2077718f71487197adf"} Jul 22 17:35:22.758814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.758702 2582 scope.go:117] "RemoveContainer" containerID="44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4" Jul 22 17:35:22.767248 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.767229 2582 scope.go:117] "RemoveContainer" containerID="44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4" Jul 22 17:35:22.767571 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:35:22.767551 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4\": container with ID starting with 44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4 not found: ID does not exist" containerID="44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4" Jul 22 17:35:22.767625 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.767580 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4"} err="failed to get container status \"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4\": rpc error: code = NotFound desc = could not find container \"44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4\": container with ID starting with 44ee8c49a038080e6e7224204997ec5e8972f5c0e4914b1130945eb3450b81d4 not found: ID does not exist" Jul 22 17:35:22.773524 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.773494 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:35:22.777409 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:22.777377 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-668c6cfddf-zkhqq"] Jul 22 17:35:24.554830 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.554787 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9574cda0-e08d-4d39-b45a-839b3ef46448" path="/var/lib/kubelet/pods/9574cda0-e08d-4d39-b45a-839b3ef46448/volumes" Jul 22 17:35:24.602813 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.602776 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:35:24.603017 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.602978 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" podUID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" containerName="postgres" containerID="cri-o://a374d7e0fbcccb5f6fcfbe2ff903576d047a846b7d03d0d1b05e5272fcaf8960" gracePeriod=30 Jul 22 17:35:24.768227 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.768197 2582 generic.go:356] "Generic (PLEG): container finished" podID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" containerID="a374d7e0fbcccb5f6fcfbe2ff903576d047a846b7d03d0d1b05e5272fcaf8960" exitCode=0 Jul 22 17:35:24.768227 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.768235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" event={"ID":"eeaf0d0b-96be-4064-80cb-e3db8d64bce2","Type":"ContainerDied","Data":"a374d7e0fbcccb5f6fcfbe2ff903576d047a846b7d03d0d1b05e5272fcaf8960"} Jul 22 17:35:24.854469 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:24.854434 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:35:25.022209 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.022170 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knvb5\" (UniqueName: \"kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5\") pod \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " Jul 22 17:35:25.022209 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.022217 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata\") pod \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\" (UID: \"eeaf0d0b-96be-4064-80cb-e3db8d64bce2\") " Jul 22 17:35:25.024534 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.024501 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5" (OuterVolumeSpecName: "kube-api-access-knvb5") pod "eeaf0d0b-96be-4064-80cb-e3db8d64bce2" (UID: "eeaf0d0b-96be-4064-80cb-e3db8d64bce2"). InnerVolumeSpecName "kube-api-access-knvb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:35:25.053814 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.053751 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "eeaf0d0b-96be-4064-80cb-e3db8d64bce2" (UID: "eeaf0d0b-96be-4064-80cb-e3db8d64bce2"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:35:25.122996 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.122885 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knvb5\" (UniqueName: \"kubernetes.io/projected/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-kube-api-access-knvb5\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:35:25.122996 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.122958 2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/eeaf0d0b-96be-4064-80cb-e3db8d64bce2-postgresdata\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:35:25.774114 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.774071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" event={"ID":"eeaf0d0b-96be-4064-80cb-e3db8d64bce2","Type":"ContainerDied","Data":"4f60ce3b099ff01c901de3e6c2e74f8e4ccc8930c4d0df351df13ca0c1bde4a7"} Jul 22 17:35:25.774568 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.774137 2582 scope.go:117] "RemoveContainer" containerID="a374d7e0fbcccb5f6fcfbe2ff903576d047a846b7d03d0d1b05e5272fcaf8960" Jul 22 17:35:25.774568 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.774095 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-t69b7" Jul 22 17:35:25.794154 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.794117 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:35:25.801406 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:25.798599 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-t69b7"] Jul 22 17:35:26.554442 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:26.554407 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" path="/var/lib/kubelet/pods/eeaf0d0b-96be-4064-80cb-e3db8d64bce2/volumes" Jul 22 17:35:32.749853 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.749811 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750128 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9574cda0-e08d-4d39-b45a-839b3ef46448" containerName="manager" Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750143 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9574cda0-e08d-4d39-b45a-839b3ef46448" containerName="manager" Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750160 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" containerName="postgres" Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750168 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" containerName="postgres" Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750223 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9574cda0-e08d-4d39-b45a-839b3ef46448" containerName="manager" Jul 22 17:35:32.750287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.750231 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeaf0d0b-96be-4064-80cb-e3db8d64bce2" containerName="postgres" Jul 22 17:35:32.753098 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.753078 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:32.756203 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.756161 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 22 17:35:32.756445 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.756427 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-mmrl4\"" Jul 22 17:35:32.756727 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.756710 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 22 17:35:32.770746 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.770705 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:35:32.786576 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.786538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswhl\" (UniqueName: \"kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl\") pod \"feast-operator-controller-manager-7495bcd-v8cmd\" (UID: \"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:32.887555 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.887505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswhl\" (UniqueName: \"kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl\") pod \"feast-operator-controller-manager-7495bcd-v8cmd\" (UID: \"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:32.896786 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:32.896751 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswhl\" (UniqueName: \"kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl\") pod \"feast-operator-controller-manager-7495bcd-v8cmd\" (UID: \"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:33.064143 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:33.064037 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:33.230091 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:33.230053 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:35:33.233654 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:35:33.233608 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0c2fdb_73d7_4fac_b58b_ffa53f2e6012.slice/crio-ba1b8b5dbc176ab9bc7d9e3b25056da59e63fae3e33b96a4746988f2a1610205 WatchSource:0}: Error finding container ba1b8b5dbc176ab9bc7d9e3b25056da59e63fae3e33b96a4746988f2a1610205: Status 404 returned error can't find the container with id ba1b8b5dbc176ab9bc7d9e3b25056da59e63fae3e33b96a4746988f2a1610205 Jul 22 17:35:33.235615 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:33.235596 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:35:33.805992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:33.805953 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" event={"ID":"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012","Type":"ContainerStarted","Data":"ba1b8b5dbc176ab9bc7d9e3b25056da59e63fae3e33b96a4746988f2a1610205"} Jul 22 17:35:36.819792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:36.819750 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" event={"ID":"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012","Type":"ContainerStarted","Data":"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27"} Jul 22 17:35:36.820308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:36.819869 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:36.837329 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:36.837270 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" podStartSLOduration=1.8660038860000001 podStartE2EDuration="4.837252763s" totalImagesPullingTime="2.971248877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:35:36.835915927 +0000 UTC m=+1116.852261155" watchObservedRunningTime="2026-07-22 17:35:36.837252763 +0000 UTC m=+1116.853597989" Jul 22 17:35:47.826422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:47.826390 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:35:49.377104 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.377068 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:35:49.380852 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.380822 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.384522 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384495 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 22 17:35:49.384770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384745 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 22 17:35:49.384859 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384769 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 22 17:35:49.384957 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384861 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 22 17:35:49.384957 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384872 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-94fqr\"" Jul 22 17:35:49.384957 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384878 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 22 17:35:49.385147 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.384999 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 22 17:35:49.396117 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.396081 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:35:49.427516 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.427516 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.427732 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.427732 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.427732 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.427732 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.427717 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxv5\" (UniqueName: \"kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529134 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529134 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529363 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529363 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529363 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529363 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxv5\" (UniqueName: \"kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.529735 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.529701 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.531913 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.531887 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.532069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.531941 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.532069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.531950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.532069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.531947 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.536850 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.536823 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxv5\" (UniqueName: \"kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5\") pod \"feast-simple-feast-setup-777d6cc998-vfvxk\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.710322 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.710288 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:35:49.856299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.856263 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:35:49.860149 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:35:49.860114 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod301038e4_3a5a_4867_8e62_49e13fb01a33.slice/crio-c714c8d5df1ac3054803474dae4acd23623ec7f0ed2bf68a803d5bffb9851762 WatchSource:0}: Error finding container c714c8d5df1ac3054803474dae4acd23623ec7f0ed2bf68a803d5bffb9851762: Status 404 returned error can't find the container with id c714c8d5df1ac3054803474dae4acd23623ec7f0ed2bf68a803d5bffb9851762 Jul 22 17:35:49.869985 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:35:49.869952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"c714c8d5df1ac3054803474dae4acd23623ec7f0ed2bf68a803d5bffb9851762"} Jul 22 17:36:00.478715 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:00.478678 2582 scope.go:117] "RemoveContainer" containerID="3f6b667429b062c1afb9c066e4e846144caf890155c3e279e370f74096468496" Jul 22 17:36:05.298794 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:05.298756 2582 scope.go:117] "RemoveContainer" containerID="beec94f55b74a38e9d11bb8287ad58900521ad708bcbc13c4080c6fe26120b17" Jul 22 17:36:05.946319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:05.946278 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a"} Jul 22 17:36:10.968693 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:10.968655 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a" exitCode=0 Jul 22 17:36:10.969146 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:10.968730 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a"} Jul 22 17:36:11.974628 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:11.974580 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703"} Jul 22 17:36:18.000000 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:17.999966 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703" exitCode=0 Jul 22 17:36:18.000393 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:18.000043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703"} Jul 22 17:36:19.010385 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.010330 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b"} Jul 22 17:36:19.010895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.010408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1"} Jul 22 17:36:19.010895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.010430 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5"} Jul 22 17:36:19.010895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.010448 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerStarted","Data":"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465"} Jul 22 17:36:19.039597 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.039515 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podStartSLOduration=14.509973697 podStartE2EDuration="30.039490699s" totalImagesPullingTime="15.529517002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:36:19.036810759 +0000 UTC m=+1159.053155986" watchObservedRunningTime="2026-07-22 17:36:19.039490699 +0000 UTC m=+1159.055835927" Jul 22 17:36:19.710569 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710506 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.710809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710753 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.710809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710790 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.710809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710809 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.711002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710828 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.711002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710845 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.711002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710862 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.711002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.710878 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:19.713628 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.713216 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Jul 22 17:36:19.713628 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.713237 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Jul 22 17:36:19.713628 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.713264 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused" Jul 22 17:36:19.713628 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:19.713345 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jul 22 17:36:22.711362 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:22.711265 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Jul 22 17:36:22.712054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:22.711301 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jul 22 17:36:22.712195 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:22.711314 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Jul 22 17:36:22.712195 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:22.711314 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused" Jul 22 17:36:25.712081 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.712045 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.712562 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.712248 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.712562 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.712508 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.713127 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.713100 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.713427 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.713410 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.713545 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.713470 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:25.717913 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:25.717885 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:36:26.049860 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:36:26.049771 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:37:00.450686 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:00.450649 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:37:00.452622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:00.452597 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:37:28.682595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.682550 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:37:28.683141 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.683058 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" containerID="cri-o://adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" gracePeriod=30 Jul 22 17:37:28.683141 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.683120 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" containerID="cri-o://b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" gracePeriod=30 Jul 22 17:37:28.683388 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.683346 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" containerID="cri-o://8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" gracePeriod=30 Jul 22 17:37:28.683540 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.683482 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" containerID="cri-o://7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" gracePeriod=30 Jul 22 17:37:28.994206 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.994169 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:37:28.997761 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.997735 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:28.999969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:28.999911 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xq9bs\"" Jul 22 17:37:29.013729 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.013689 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:37:29.094002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.093962 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.094185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.094058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.094185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.094139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.094274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.094204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqzw\" (UniqueName: \"kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.094274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.094250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.094366 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.094279 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.195849 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.195806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196047 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.195885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqzw\" (UniqueName: \"kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196047 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.195945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196047 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.195980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196047 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.195991 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 22 17:37:29.196047 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.196013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.196065 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls podName:37288111-1480-46ac-9294-32f3c6158189 nodeName:}" failed. No retries permitted until 2026-07-22 17:37:29.696043593 +0000 UTC m=+1229.712388801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls") pod "feast-simple-feast-setup-777d6cc998-hl2lz" (UID: "37288111-1480-46ac-9294-32f3c6158189") : secret "feast-simple-feast-setup-online-tls" not found Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.196090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.196115 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.196179 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls podName:37288111-1480-46ac-9294-32f3c6158189 nodeName:}" failed. No retries permitted until 2026-07-22 17:37:29.696158861 +0000 UTC m=+1229.712504082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls") pod "feast-simple-feast-setup-777d6cc998-hl2lz" (UID: "37288111-1480-46ac-9294-32f3c6158189") : secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.196115 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 22 17:37:29.196306 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:29.196221 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls podName:37288111-1480-46ac-9294-32f3c6158189 nodeName:}" failed. No retries permitted until 2026-07-22 17:37:29.69621129 +0000 UTC m=+1229.712556528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls") pod "feast-simple-feast-setup-777d6cc998-hl2lz" (UID: "37288111-1480-46ac-9294-32f3c6158189") : secret "feast-simple-feast-setup-registry-tls" not found Jul 22 17:37:29.196539 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.196446 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.198646 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.198626 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.204881 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.204847 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqzw\" (UniqueName: \"kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.700729 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.700698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.701157 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.700754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.701157 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.700776 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.703314 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.703279 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.703435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.703324 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.703476 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.703447 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-hl2lz\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:29.907197 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:29.907155 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:30.049344 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.049307 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:37:30.052522 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:37:30.052492 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37288111_1480_46ac_9294_32f3c6158189.slice/crio-cd6e02c4f5105e41746cf7399f6f7b6a401686722f990b406f42668ae2357f3c WatchSource:0}: Error finding container cd6e02c4f5105e41746cf7399f6f7b6a401686722f990b406f42668ae2357f3c: Status 404 returned error can't find the container with id cd6e02c4f5105e41746cf7399f6f7b6a401686722f990b406f42668ae2357f3c Jul 22 17:37:30.294815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.294726 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" exitCode=0 Jul 22 17:37:30.294815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.294752 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" exitCode=0 Jul 22 17:37:30.294815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.294790 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b"} Jul 22 17:37:30.295116 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.294835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5"} Jul 22 17:37:30.297270 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.296444 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34"} Jul 22 17:37:30.297270 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:30.296488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"cd6e02c4f5105e41746cf7399f6f7b6a401686722f990b406f42668ae2357f3c"} Jul 22 17:37:35.317596 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:35.317556 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34" exitCode=0 Jul 22 17:37:35.318176 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:35.317623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34"} Jul 22 17:37:35.713734 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:35.713687 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Jul 22 17:37:36.047397 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:36.047300 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jul 22 17:37:36.324045 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:36.323956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036"} Jul 22 17:37:42.350175 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:42.350134 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036" exitCode=0 Jul 22 17:37:42.350568 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:42.350197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036"} Jul 22 17:37:43.360466 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:43.360413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac"} Jul 22 17:37:43.361007 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:43.360481 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8"} Jul 22 17:37:43.361007 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:43.360507 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3"} Jul 22 17:37:43.361007 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:43.360527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerStarted","Data":"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446"} Jul 22 17:37:43.385138 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:43.385057 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podStartSLOduration=15.385033317 podStartE2EDuration="15.385033317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:37:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:37:43.382738598 +0000 UTC m=+1243.399083837" watchObservedRunningTime="2026-07-22 17:37:43.385033317 +0000 UTC m=+1243.401378544" Jul 22 17:37:44.908148 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.908075 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:44.908148 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.908146 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:44.908727 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.908166 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:44.908727 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.908183 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:44.910276 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.910233 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Jul 22 17:37:44.910552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.910268 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 22 17:37:44.910688 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.910268 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 22 17:37:44.910688 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:44.910311 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jul 22 17:37:45.713885 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:45.713834 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Jul 22 17:37:46.047760 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:46.047635 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jul 22 17:37:47.908418 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:47.908367 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 22 17:37:47.909026 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:47.908392 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Jul 22 17:37:47.909128 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:47.908392 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jul 22 17:37:47.909128 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:47.908401 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 22 17:37:49.907302 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:49.907256 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:49.907697 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:49.907318 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:49.907697 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:49.907334 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:49.907697 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:49.907346 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.909209 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.909178 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.909671 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.909376 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.910074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.910008 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.910167 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.910088 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.910449 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.910429 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:50.914522 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:50.914498 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:51.401127 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:51.401094 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:51.404293 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:51.404265 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:37:55.713669 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:55.713623 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Jul 22 17:37:55.714235 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:55.713782 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:37:56.047001 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:56.046879 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Jul 22 17:37:56.047170 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:56.047090 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:37:59.340729 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.340698 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:37:59.369881 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.369792 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.369881 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.369863 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.369881 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.369906 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.370242 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.369985 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwxv5\" (UniqueName: \"kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.370242 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.370036 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.370242 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.370086 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls\") pod \"301038e4-3a5a-4867-8e62-49e13fb01a33\" (UID: \"301038e4-3a5a-4867-8e62-49e13fb01a33\") " Jul 22 17:37:59.370844 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.370808 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data" (OuterVolumeSpecName: "feast-data") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:37:59.372817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.372776 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:37:59.372918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.372806 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:37:59.372918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.372822 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls" (OuterVolumeSpecName: "online-tls") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:37:59.372918 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.372883 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:37:59.373127 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.373007 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5" (OuterVolumeSpecName: "kube-api-access-dwxv5") pod "301038e4-3a5a-4867-8e62-49e13fb01a33" (UID: "301038e4-3a5a-4867-8e62-49e13fb01a33"). InnerVolumeSpecName "kube-api-access-dwxv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:37:59.438668 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438627 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" exitCode=137 Jul 22 17:37:59.438668 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438662 2582 generic.go:356] "Generic (PLEG): container finished" podID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerID="8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" exitCode=137 Jul 22 17:37:59.438892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438708 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" Jul 22 17:37:59.438892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438703 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1"} Jul 22 17:37:59.438892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465"} Jul 22 17:37:59.438892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk" event={"ID":"301038e4-3a5a-4867-8e62-49e13fb01a33","Type":"ContainerDied","Data":"c714c8d5df1ac3054803474dae4acd23623ec7f0ed2bf68a803d5bffb9851762"} Jul 22 17:37:59.438892 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.438787 2582 scope.go:117] "RemoveContainer" containerID="7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" Jul 22 17:37:59.447652 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.447626 2582 scope.go:117] "RemoveContainer" containerID="adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" Jul 22 17:37:59.455838 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.455820 2582 scope.go:117] "RemoveContainer" containerID="b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" Jul 22 17:37:59.462824 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.462787 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:37:59.464880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.464856 2582 scope.go:117] "RemoveContainer" containerID="8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" Jul 22 17:37:59.467352 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.467331 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vfvxk"] Jul 22 17:37:59.470987 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.470959 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.471088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.471025 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.471088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.471045 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/301038e4-3a5a-4867-8e62-49e13fb01a33-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.471088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.471059 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwxv5\" (UniqueName: \"kubernetes.io/projected/301038e4-3a5a-4867-8e62-49e13fb01a33-kube-api-access-dwxv5\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.471088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.471073 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.471088 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.471087 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/301038e4-3a5a-4867-8e62-49e13fb01a33-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:37:59.474049 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.474026 2582 scope.go:117] "RemoveContainer" containerID="5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703" Jul 22 17:37:59.482412 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.482393 2582 scope.go:117] "RemoveContainer" containerID="cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a" Jul 22 17:37:59.490558 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.490536 2582 scope.go:117] "RemoveContainer" containerID="7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" Jul 22 17:37:59.490872 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.490850 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b\": container with ID starting with 7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b not found: ID does not exist" containerID="7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" Jul 22 17:37:59.490971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.490885 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b"} err="failed to get container status \"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b\": rpc error: code = NotFound desc = could not find container \"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b\": container with ID starting with 7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b not found: ID does not exist" Jul 22 17:37:59.490971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.490914 2582 scope.go:117] "RemoveContainer" containerID="adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" Jul 22 17:37:59.491246 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.491227 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1\": container with ID starting with adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1 not found: ID does not exist" containerID="adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" Jul 22 17:37:59.491287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491253 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1"} err="failed to get container status \"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1\": rpc error: code = NotFound desc = could not find container \"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1\": container with ID starting with adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1 not found: ID does not exist" Jul 22 17:37:59.491287 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491270 2582 scope.go:117] "RemoveContainer" containerID="b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" Jul 22 17:37:59.491496 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.491479 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5\": container with ID starting with b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5 not found: ID does not exist" containerID="b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" Jul 22 17:37:59.491542 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491505 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5"} err="failed to get container status \"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5\": rpc error: code = NotFound desc = could not find container \"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5\": container with ID starting with b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5 not found: ID does not exist" Jul 22 17:37:59.491542 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491523 2582 scope.go:117] "RemoveContainer" containerID="8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" Jul 22 17:37:59.491728 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.491712 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465\": container with ID starting with 8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465 not found: ID does not exist" containerID="8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" Jul 22 17:37:59.491767 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491732 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465"} err="failed to get container status \"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465\": rpc error: code = NotFound desc = could not find container \"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465\": container with ID starting with 8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465 not found: ID does not exist" Jul 22 17:37:59.491767 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491746 2582 scope.go:117] "RemoveContainer" containerID="5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703" Jul 22 17:37:59.491980 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.491963 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703\": container with ID starting with 5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703 not found: ID does not exist" containerID="5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703" Jul 22 17:37:59.492027 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491985 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703"} err="failed to get container status \"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703\": rpc error: code = NotFound desc = could not find container \"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703\": container with ID starting with 5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703 not found: ID does not exist" Jul 22 17:37:59.492027 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.491999 2582 scope.go:117] "RemoveContainer" containerID="cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a" Jul 22 17:37:59.492211 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:37:59.492195 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a\": container with ID starting with cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a not found: ID does not exist" containerID="cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a" Jul 22 17:37:59.492277 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492219 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a"} err="failed to get container status \"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a\": rpc error: code = NotFound desc = could not find container \"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a\": container with ID starting with cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a not found: ID does not exist" Jul 22 17:37:59.492277 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492240 2582 scope.go:117] "RemoveContainer" containerID="7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b" Jul 22 17:37:59.492491 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492472 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b"} err="failed to get container status \"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b\": rpc error: code = NotFound desc = could not find container \"7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b\": container with ID starting with 7b341ebc23db1c0301491ad935d382dcf83e08db6dbd0e87698cc2ac37592d2b not found: ID does not exist" Jul 22 17:37:59.492537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492492 2582 scope.go:117] "RemoveContainer" containerID="adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1" Jul 22 17:37:59.492696 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492681 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1"} err="failed to get container status \"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1\": rpc error: code = NotFound desc = could not find container \"adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1\": container with ID starting with adc514d59a2f04ac45f8ba92a41e582ced0534e09d7273bad3ed9baa05cb19b1 not found: ID does not exist" Jul 22 17:37:59.492746 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492696 2582 scope.go:117] "RemoveContainer" containerID="b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5" Jul 22 17:37:59.492896 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492877 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5"} err="failed to get container status \"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5\": rpc error: code = NotFound desc = could not find container \"b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5\": container with ID starting with b27a25fa46ac746e966aa59687eb4e97f18acf19b96474353ab0fd4d725c68f5 not found: ID does not exist" Jul 22 17:37:59.492963 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.492900 2582 scope.go:117] "RemoveContainer" containerID="8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465" Jul 22 17:37:59.493192 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.493174 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465"} err="failed to get container status \"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465\": rpc error: code = NotFound desc = could not find container \"8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465\": container with ID starting with 8ebd3451fa2638acc552dd2f6a79541599980389c70b9dec113583d6a44d4465 not found: ID does not exist" Jul 22 17:37:59.493234 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.493194 2582 scope.go:117] "RemoveContainer" containerID="5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703" Jul 22 17:37:59.493417 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.493397 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703"} err="failed to get container status \"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703\": rpc error: code = NotFound desc = could not find container \"5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703\": container with ID starting with 5499453499f20ad23d78e50e09d7a8595385b26764bd3f9e15894893c5cd6703 not found: ID does not exist" Jul 22 17:37:59.493487 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.493418 2582 scope.go:117] "RemoveContainer" containerID="cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a" Jul 22 17:37:59.493643 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:37:59.493624 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a"} err="failed to get container status \"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a\": rpc error: code = NotFound desc = could not find container \"cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a\": container with ID starting with cbb41dc84ccb9ebf944233c84f10e8184e816d57c42cb579a6bc08266e8bf22a not found: ID does not exist" Jul 22 17:38:00.555489 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:00.555450 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" path="/var/lib/kubelet/pods/301038e4-3a5a-4867-8e62-49e13fb01a33/volumes" Jul 22 17:38:54.697479 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697435 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697749 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697760 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697773 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="feast-apply" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697778 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="feast-apply" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697792 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697798 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697806 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="feast-init" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697811 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="feast-init" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697818 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697823 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697830 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697835 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697877 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="online" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697885 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="offline" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697892 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="ui" Jul 22 17:38:54.697992 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.697898 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="301038e4-3a5a-4867-8e62-49e13fb01a33" containerName="registry" Jul 22 17:38:54.701276 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.701249 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.703660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.703631 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-7pjxc\"" Jul 22 17:38:54.703660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.703630 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 22 17:38:54.703827 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.703633 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 22 17:38:54.703827 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.703633 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 22 17:38:54.703827 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.703676 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 22 17:38:54.704022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.704006 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 22 17:38:54.704094 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.704007 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 22 17:38:54.714386 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.714360 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:38:54.820515 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.820515 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.820776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.820776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.820776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mldl4\" (UniqueName: \"kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.820776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.820734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.921828 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.921780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.921828 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.921836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.921975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.922038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.922079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mldl4\" (UniqueName: \"kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922252 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:38:54.922119 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 22 17:38:54.922252 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:38:54.922199 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls podName:aad9e276-d7f1-4fdd-a2af-a22d1611332c nodeName:}" failed. No retries permitted until 2026-07-22 17:38:55.422175639 +0000 UTC m=+1315.438520857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-48kwd" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 22 17:38:54.922252 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.922122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922489 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.922448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.922647 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.922562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.924450 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.924431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.924531 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.924465 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:54.930716 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:54.930678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mldl4\" (UniqueName: \"kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:55.427792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:55.427750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:55.430321 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:55.430293 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-48kwd\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:55.611349 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:55.611304 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:38:55.754990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:55.754894 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:38:55.757763 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:38:55.757729 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad9e276_d7f1_4fdd_a2af_a22d1611332c.slice/crio-7a5696e8670089a3b299230b9332f971e971e318ce46610d04b9bd5eb89f39f5 WatchSource:0}: Error finding container 7a5696e8670089a3b299230b9332f971e971e318ce46610d04b9bd5eb89f39f5: Status 404 returned error can't find the container with id 7a5696e8670089a3b299230b9332f971e971e318ce46610d04b9bd5eb89f39f5 Jul 22 17:38:56.653428 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:56.653394 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"e280580b0fb641fe81ad76f92ae749b1eb6b268c0fca870cc8bb430fcb082ab6"} Jul 22 17:38:56.653637 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:38:56.653445 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"7a5696e8670089a3b299230b9332f971e971e318ce46610d04b9bd5eb89f39f5"} Jul 22 17:39:01.673251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:01.673215 2582 generic.go:356] "Generic (PLEG): container finished" podID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerID="e280580b0fb641fe81ad76f92ae749b1eb6b268c0fca870cc8bb430fcb082ab6" exitCode=0 Jul 22 17:39:01.673666 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:01.673289 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"e280580b0fb641fe81ad76f92ae749b1eb6b268c0fca870cc8bb430fcb082ab6"} Jul 22 17:39:02.680086 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:02.680047 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"00e4b8f03edd7228fc1b8a2020407c5ce70a047b02faca463bcdd58defd35bfe"} Jul 22 17:39:08.707969 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:08.707897 2582 generic.go:356] "Generic (PLEG): container finished" podID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerID="00e4b8f03edd7228fc1b8a2020407c5ce70a047b02faca463bcdd58defd35bfe" exitCode=0 Jul 22 17:39:08.708388 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:08.707968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"00e4b8f03edd7228fc1b8a2020407c5ce70a047b02faca463bcdd58defd35bfe"} Jul 22 17:39:09.716114 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:09.716079 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"9e13b74ad4b33d5f56b1f0379bd67e5d3dbc29987ec901f63dc3c20fca32031c"} Jul 22 17:39:09.716694 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:09.716128 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"3e3ce6e6bedce76bd17901281a2782bcb06fad3203ecbe49a9f5d175e985f810"} Jul 22 17:39:09.716694 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:09.716141 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerStarted","Data":"630c231a63bc807a7e2dc6bef1579a4c190ce92bafbcb88491b9bb7d3f4df13c"} Jul 22 17:39:09.741656 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:09.741194 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podStartSLOduration=15.741169672 podStartE2EDuration="15.741169672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:39:09.739789234 +0000 UTC m=+1329.756134461" watchObservedRunningTime="2026-07-22 17:39:09.741169672 +0000 UTC m=+1329.757514899" Jul 22 17:39:10.612515 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.612468 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:10.612724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.612617 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:10.612724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.612639 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:10.614667 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.614618 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Jul 22 17:39:10.614667 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.614647 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 22 17:39:10.614848 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:10.614666 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 22 17:39:13.611756 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:13.611703 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 22 17:39:13.612206 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:13.611756 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 22 17:39:13.612206 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:13.611703 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Jul 22 17:39:15.611748 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:15.611700 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:15.612191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:15.611784 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:15.612191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:15.611828 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.612445 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.612408 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.612986 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.612680 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.619486 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.619460 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.748572 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.748536 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.748792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.748734 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:39:16.752780 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:39:16.752750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:40:17.998478 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:17.998437 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:40:17.999093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:17.998734 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" containerID="cri-o://630c231a63bc807a7e2dc6bef1579a4c190ce92bafbcb88491b9bb7d3f4df13c" gracePeriod=30 Jul 22 17:40:17.999093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:17.998796 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" containerID="cri-o://3e3ce6e6bedce76bd17901281a2782bcb06fad3203ecbe49a9f5d175e985f810" gracePeriod=30 Jul 22 17:40:17.999093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:17.998817 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" containerID="cri-o://9e13b74ad4b33d5f56b1f0379bd67e5d3dbc29987ec901f63dc3c20fca32031c" gracePeriod=30 Jul 22 17:40:18.178213 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.178176 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:40:18.178528 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.178484 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" containerID="cri-o://a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" gracePeriod=30 Jul 22 17:40:18.178622 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.178574 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" containerID="cri-o://f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" gracePeriod=30 Jul 22 17:40:18.178676 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.178620 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" containerID="cri-o://864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" gracePeriod=30 Jul 22 17:40:18.178723 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.178574 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" containerID="cri-o://5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" gracePeriod=30 Jul 22 17:40:18.990296 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.990264 2582 generic.go:356] "Generic (PLEG): container finished" podID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerID="9e13b74ad4b33d5f56b1f0379bd67e5d3dbc29987ec901f63dc3c20fca32031c" exitCode=0 Jul 22 17:40:18.990296 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.990289 2582 generic.go:356] "Generic (PLEG): container finished" podID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerID="630c231a63bc807a7e2dc6bef1579a4c190ce92bafbcb88491b9bb7d3f4df13c" exitCode=0 Jul 22 17:40:18.990503 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.990333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"9e13b74ad4b33d5f56b1f0379bd67e5d3dbc29987ec901f63dc3c20fca32031c"} Jul 22 17:40:18.990503 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.990379 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"630c231a63bc807a7e2dc6bef1579a4c190ce92bafbcb88491b9bb7d3f4df13c"} Jul 22 17:40:18.993281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.993257 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" exitCode=0 Jul 22 17:40:18.993375 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:18.993308 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac"} Jul 22 17:40:19.999966 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:19.999914 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" exitCode=0 Jul 22 17:40:20.000351 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:19.999989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3"} Jul 22 17:40:20.910496 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:20.910451 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 22 17:40:21.401365 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:21.401321 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 22 17:40:26.748980 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:26.748903 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 22 17:40:26.749398 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:26.748950 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 22 17:40:30.910351 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:30.910294 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 22 17:40:31.401242 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:31.401197 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 22 17:40:36.748389 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:36.748337 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 22 17:40:36.748816 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:36.748341 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 22 17:40:40.910515 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:40.910470 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 22 17:40:40.911013 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:40.910647 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:40:41.401219 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:41.401166 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 22 17:40:41.401432 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:41.401327 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:40:46.748714 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:46.748663 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 22 17:40:46.749204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:46.748687 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 22 17:40:46.749204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:46.748801 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:40:46.749204 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:46.749010 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:40:48.112693 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.112658 2582 generic.go:356] "Generic (PLEG): container finished" podID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerID="3e3ce6e6bedce76bd17901281a2782bcb06fad3203ecbe49a9f5d175e985f810" exitCode=137 Jul 22 17:40:48.113061 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.112726 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"3e3ce6e6bedce76bd17901281a2782bcb06fad3203ecbe49a9f5d175e985f810"} Jul 22 17:40:48.647706 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.647680 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:40:48.715093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715062 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715112 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mldl4\" (UniqueName: \"kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715159 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715201 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715232 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715288 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715271 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") pod \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\" (UID: \"aad9e276-d7f1-4fdd-a2af-a22d1611332c\") " Jul 22 17:40:48.715608 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715580 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:40:48.715710 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.715679 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data" (OuterVolumeSpecName: "feast-data") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:40:48.717580 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.717553 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls" (OuterVolumeSpecName: "online-tls") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.717580 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.717571 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.717725 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.717596 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4" (OuterVolumeSpecName: "kube-api-access-mldl4") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "kube-api-access-mldl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:40:48.717815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.717801 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "aad9e276-d7f1-4fdd-a2af-a22d1611332c" (UID: "aad9e276-d7f1-4fdd-a2af-a22d1611332c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.815878 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815850 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aad9e276-d7f1-4fdd-a2af-a22d1611332c-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.815878 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815877 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.816071 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815889 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.816071 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815899 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9e276-d7f1-4fdd-a2af-a22d1611332c-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.816071 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815910 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9e276-d7f1-4fdd-a2af-a22d1611332c-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.816071 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.815938 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mldl4\" (UniqueName: \"kubernetes.io/projected/aad9e276-d7f1-4fdd-a2af-a22d1611332c-kube-api-access-mldl4\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:48.824639 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.824612 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:40:48.916403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916361 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zqzw\" (UniqueName: \"kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.916403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916412 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.916772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916432 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.916772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916464 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.916772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916491 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.916772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.916615 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") pod \"37288111-1480-46ac-9294-32f3c6158189\" (UID: \"37288111-1480-46ac-9294-32f3c6158189\") " Jul 22 17:40:48.917068 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.917039 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data" (OuterVolumeSpecName: "feast-data") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:40:48.918718 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.918691 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw" (OuterVolumeSpecName: "kube-api-access-5zqzw") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "kube-api-access-5zqzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:40:48.919195 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.919170 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.919263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.919196 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.919263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.919170 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:48.919263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:48.919213 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls" (OuterVolumeSpecName: "online-tls") pod "37288111-1480-46ac-9294-32f3c6158189" (UID: "37288111-1480-46ac-9294-32f3c6158189"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:40:49.018221 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018181 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zqzw\" (UniqueName: \"kubernetes.io/projected/37288111-1480-46ac-9294-32f3c6158189-kube-api-access-5zqzw\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.018221 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018219 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37288111-1480-46ac-9294-32f3c6158189-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.018221 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018228 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.018434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018236 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.018434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018245 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.018434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.018252 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37288111-1480-46ac-9294-32f3c6158189-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:40:49.118873 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.118785 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" Jul 22 17:40:49.119338 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.118783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd" event={"ID":"aad9e276-d7f1-4fdd-a2af-a22d1611332c","Type":"ContainerDied","Data":"7a5696e8670089a3b299230b9332f971e971e318ce46610d04b9bd5eb89f39f5"} Jul 22 17:40:49.119338 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.118948 2582 scope.go:117] "RemoveContainer" containerID="9e13b74ad4b33d5f56b1f0379bd67e5d3dbc29987ec901f63dc3c20fca32031c" Jul 22 17:40:49.121909 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.121879 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" exitCode=137 Jul 22 17:40:49.121909 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.121906 2582 generic.go:356] "Generic (PLEG): container finished" podID="37288111-1480-46ac-9294-32f3c6158189" containerID="a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" exitCode=137 Jul 22 17:40:49.122108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.121951 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8"} Jul 22 17:40:49.122108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.122007 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" Jul 22 17:40:49.122108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.122020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446"} Jul 22 17:40:49.122108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.122044 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz" event={"ID":"37288111-1480-46ac-9294-32f3c6158189","Type":"ContainerDied","Data":"cd6e02c4f5105e41746cf7399f6f7b6a401686722f990b406f42668ae2357f3c"} Jul 22 17:40:49.128469 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.128450 2582 scope.go:117] "RemoveContainer" containerID="3e3ce6e6bedce76bd17901281a2782bcb06fad3203ecbe49a9f5d175e985f810" Jul 22 17:40:49.136489 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.136464 2582 scope.go:117] "RemoveContainer" containerID="630c231a63bc807a7e2dc6bef1579a4c190ce92bafbcb88491b9bb7d3f4df13c" Jul 22 17:40:49.141986 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.141956 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:40:49.145607 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.145586 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-48kwd"] Jul 22 17:40:49.145686 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.145659 2582 scope.go:117] "RemoveContainer" containerID="00e4b8f03edd7228fc1b8a2020407c5ce70a047b02faca463bcdd58defd35bfe" Jul 22 17:40:49.153299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.153280 2582 scope.go:117] "RemoveContainer" containerID="e280580b0fb641fe81ad76f92ae749b1eb6b268c0fca870cc8bb430fcb082ab6" Jul 22 17:40:49.156365 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.156341 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:40:49.160200 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.160175 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-hl2lz"] Jul 22 17:40:49.161340 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.161319 2582 scope.go:117] "RemoveContainer" containerID="f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" Jul 22 17:40:49.169417 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.169397 2582 scope.go:117] "RemoveContainer" containerID="5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" Jul 22 17:40:49.176884 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.176862 2582 scope.go:117] "RemoveContainer" containerID="864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" Jul 22 17:40:49.184580 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.184561 2582 scope.go:117] "RemoveContainer" containerID="a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" Jul 22 17:40:49.192040 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.192019 2582 scope.go:117] "RemoveContainer" containerID="cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036" Jul 22 17:40:49.199304 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.199283 2582 scope.go:117] "RemoveContainer" containerID="f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34" Jul 22 17:40:49.206913 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.206891 2582 scope.go:117] "RemoveContainer" containerID="f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" Jul 22 17:40:49.207243 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.207222 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac\": container with ID starting with f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac not found: ID does not exist" containerID="f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" Jul 22 17:40:49.207308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207254 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac"} err="failed to get container status \"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac\": rpc error: code = NotFound desc = could not find container \"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac\": container with ID starting with f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac not found: ID does not exist" Jul 22 17:40:49.207308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207277 2582 scope.go:117] "RemoveContainer" containerID="5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" Jul 22 17:40:49.207523 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.207505 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8\": container with ID starting with 5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8 not found: ID does not exist" containerID="5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" Jul 22 17:40:49.207574 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207530 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8"} err="failed to get container status \"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8\": rpc error: code = NotFound desc = could not find container \"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8\": container with ID starting with 5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8 not found: ID does not exist" Jul 22 17:40:49.207574 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207552 2582 scope.go:117] "RemoveContainer" containerID="864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" Jul 22 17:40:49.207806 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.207790 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3\": container with ID starting with 864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3 not found: ID does not exist" containerID="864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" Jul 22 17:40:49.207857 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207811 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3"} err="failed to get container status \"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3\": rpc error: code = NotFound desc = could not find container \"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3\": container with ID starting with 864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3 not found: ID does not exist" Jul 22 17:40:49.207857 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.207827 2582 scope.go:117] "RemoveContainer" containerID="a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" Jul 22 17:40:49.208122 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.208103 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446\": container with ID starting with a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446 not found: ID does not exist" containerID="a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" Jul 22 17:40:49.208178 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208127 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446"} err="failed to get container status \"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446\": rpc error: code = NotFound desc = could not find container \"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446\": container with ID starting with a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446 not found: ID does not exist" Jul 22 17:40:49.208178 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208141 2582 scope.go:117] "RemoveContainer" containerID="cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036" Jul 22 17:40:49.208391 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.208375 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036\": container with ID starting with cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036 not found: ID does not exist" containerID="cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036" Jul 22 17:40:49.208439 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208396 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036"} err="failed to get container status \"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036\": rpc error: code = NotFound desc = could not find container \"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036\": container with ID starting with cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036 not found: ID does not exist" Jul 22 17:40:49.208439 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208412 2582 scope.go:117] "RemoveContainer" containerID="f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34" Jul 22 17:40:49.208623 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:40:49.208605 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34\": container with ID starting with f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34 not found: ID does not exist" containerID="f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34" Jul 22 17:40:49.208661 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208627 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34"} err="failed to get container status \"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34\": rpc error: code = NotFound desc = could not find container \"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34\": container with ID starting with f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34 not found: ID does not exist" Jul 22 17:40:49.208661 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208642 2582 scope.go:117] "RemoveContainer" containerID="f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac" Jul 22 17:40:49.208873 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208853 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac"} err="failed to get container status \"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac\": rpc error: code = NotFound desc = could not find container \"f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac\": container with ID starting with f1377319d0091c379203d521a2b66614a001fddb2e99405eafb47fa2428decac not found: ID does not exist" Jul 22 17:40:49.208986 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.208874 2582 scope.go:117] "RemoveContainer" containerID="5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8" Jul 22 17:40:49.209145 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209128 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8"} err="failed to get container status \"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8\": rpc error: code = NotFound desc = could not find container \"5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8\": container with ID starting with 5f758f18c803e84872da29dfea8f448ae08f864604bff513b2bebdce3e60f7f8 not found: ID does not exist" Jul 22 17:40:49.209185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209146 2582 scope.go:117] "RemoveContainer" containerID="864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3" Jul 22 17:40:49.209360 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209342 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3"} err="failed to get container status \"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3\": rpc error: code = NotFound desc = could not find container \"864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3\": container with ID starting with 864984f1d3818d41e3ead727fdddef4e61245df8e03475873accde0d3a0776d3 not found: ID does not exist" Jul 22 17:40:49.209407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209362 2582 scope.go:117] "RemoveContainer" containerID="a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446" Jul 22 17:40:49.209573 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209552 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446"} err="failed to get container status \"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446\": rpc error: code = NotFound desc = could not find container \"a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446\": container with ID starting with a33b5630f9d2cd1771568edaef2384451d8da173c41d8dc1fc494d3aaf7dc446 not found: ID does not exist" Jul 22 17:40:49.209573 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209568 2582 scope.go:117] "RemoveContainer" containerID="cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036" Jul 22 17:40:49.209770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209753 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036"} err="failed to get container status \"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036\": rpc error: code = NotFound desc = could not find container \"cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036\": container with ID starting with cf691524adc653f15410dad82d270b31c3304108d065bcc5de19b7c85d68b036 not found: ID does not exist" Jul 22 17:40:49.209822 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209770 2582 scope.go:117] "RemoveContainer" containerID="f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34" Jul 22 17:40:49.209989 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:49.209969 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34"} err="failed to get container status \"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34\": rpc error: code = NotFound desc = could not find container \"f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34\": container with ID starting with f987769c91d2cfbcb1e5ddd1887a6c33e6d2def4b325fc837d8c76f0a9b09d34 not found: ID does not exist" Jul 22 17:40:50.554681 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:50.554645 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37288111-1480-46ac-9294-32f3c6158189" path="/var/lib/kubelet/pods/37288111-1480-46ac-9294-32f3c6158189/volumes" Jul 22 17:40:50.555316 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:40:50.555300 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" path="/var/lib/kubelet/pods/aad9e276-d7f1-4fdd-a2af-a22d1611332c/volumes" Jul 22 17:41:06.824183 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:06.824135 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:41:06.824690 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:06.824465 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" podUID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" containerName="manager" containerID="cri-o://b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27" gracePeriod=10 Jul 22 17:41:07.070214 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.070184 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:41:07.162653 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.162547 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswhl\" (UniqueName: \"kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl\") pod \"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012\" (UID: \"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012\") " Jul 22 17:41:07.164775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.164746 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl" (OuterVolumeSpecName: "kube-api-access-wswhl") pod "ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" (UID: "ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012"). InnerVolumeSpecName "kube-api-access-wswhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:41:07.192212 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.192175 2582 generic.go:356] "Generic (PLEG): container finished" podID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" containerID="b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27" exitCode=0 Jul 22 17:41:07.192397 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.192218 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" Jul 22 17:41:07.192397 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.192266 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" event={"ID":"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012","Type":"ContainerDied","Data":"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27"} Jul 22 17:41:07.192397 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.192324 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd" event={"ID":"ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012","Type":"ContainerDied","Data":"ba1b8b5dbc176ab9bc7d9e3b25056da59e63fae3e33b96a4746988f2a1610205"} Jul 22 17:41:07.192397 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.192353 2582 scope.go:117] "RemoveContainer" containerID="b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27" Jul 22 17:41:07.200519 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.200503 2582 scope.go:117] "RemoveContainer" containerID="b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27" Jul 22 17:41:07.200827 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:41:07.200804 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27\": container with ID starting with b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27 not found: ID does not exist" containerID="b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27" Jul 22 17:41:07.200880 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.200837 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27"} err="failed to get container status \"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27\": rpc error: code = NotFound desc = could not find container \"b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27\": container with ID starting with b6ba9f067b3681ea2485f71ac020d2fd2940b36f4cb8e512c370106dfe851d27 not found: ID does not exist" Jul 22 17:41:07.212963 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.212908 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:41:07.218996 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.218969 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-v8cmd"] Jul 22 17:41:07.263843 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:07.263805 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswhl\" (UniqueName: \"kubernetes.io/projected/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012-kube-api-access-wswhl\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:41:08.553903 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:08.553863 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" path="/var/lib/kubelet/pods/ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012/volumes" Jul 22 17:41:11.491505 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491467 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc"] Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491856 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" containerName="manager" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491876 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" containerName="manager" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491889 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491898 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491908 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="feast-init" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491915 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="feast-init" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491945 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491953 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491963 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="feast-init" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491971 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="feast-init" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491984 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.491992 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492002 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492009 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492020 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="feast-apply" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492027 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="feast-apply" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492039 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492047 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492060 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492067 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" Jul 22 17:41:11.492074 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492084 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492092 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492114 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="feast-apply" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492125 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="feast-apply" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492203 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="online" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492217 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="online" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492227 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="offline" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492237 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="offline" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492244 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee0c2fdb-73d7-4fac-b58b-ffa53f2e6012" containerName="manager" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492251 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9e276-d7f1-4fdd-a2af-a22d1611332c" containerName="ui" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492259 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="registry" Jul 22 17:41:11.493060 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.492267 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="37288111-1480-46ac-9294-32f3c6158189" containerName="ui" Jul 22 17:41:11.497839 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.497813 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:11.499774 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.499744 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 22 17:41:11.500281 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.500255 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 22 17:41:11.500402 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.500278 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-mmrl4\"" Jul 22 17:41:11.502275 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.502250 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc"] Jul 22 17:41:11.598427 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.598388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdwr\" (UniqueName: \"kubernetes.io/projected/f74573ae-3796-4b9e-9479-ee41db8d0539-kube-api-access-cbdwr\") pod \"feast-operator-controller-manager-7495bcd-92xqc\" (UID: \"f74573ae-3796-4b9e-9479-ee41db8d0539\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:11.699364 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.699318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdwr\" (UniqueName: \"kubernetes.io/projected/f74573ae-3796-4b9e-9479-ee41db8d0539-kube-api-access-cbdwr\") pod \"feast-operator-controller-manager-7495bcd-92xqc\" (UID: \"f74573ae-3796-4b9e-9479-ee41db8d0539\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:11.712938 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.712903 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdwr\" (UniqueName: \"kubernetes.io/projected/f74573ae-3796-4b9e-9479-ee41db8d0539-kube-api-access-cbdwr\") pod \"feast-operator-controller-manager-7495bcd-92xqc\" (UID: \"f74573ae-3796-4b9e-9479-ee41db8d0539\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:11.809751 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.809660 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:11.943062 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:11.943039 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc"] Jul 22 17:41:11.945796 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:41:11.945761 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74573ae_3796_4b9e_9479_ee41db8d0539.slice/crio-4558664e0cc9345b19e1a0d809a26d52188dd6c0b60509745b8efb417e5e1283 WatchSource:0}: Error finding container 4558664e0cc9345b19e1a0d809a26d52188dd6c0b60509745b8efb417e5e1283: Status 404 returned error can't find the container with id 4558664e0cc9345b19e1a0d809a26d52188dd6c0b60509745b8efb417e5e1283 Jul 22 17:41:12.213051 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:12.213000 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" event={"ID":"f74573ae-3796-4b9e-9479-ee41db8d0539","Type":"ContainerStarted","Data":"653f328edf800d86f97568506001096f565719bb2e2448f8443c908e37c68a12"} Jul 22 17:41:12.213224 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:12.213069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" event={"ID":"f74573ae-3796-4b9e-9479-ee41db8d0539","Type":"ContainerStarted","Data":"4558664e0cc9345b19e1a0d809a26d52188dd6c0b60509745b8efb417e5e1283"} Jul 22 17:41:12.213224 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:12.213099 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:23.219077 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:23.219043 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" Jul 22 17:41:23.237256 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:23.237198 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-92xqc" podStartSLOduration=12.237177236 podStartE2EDuration="12.237177236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:41:12.230139192 +0000 UTC m=+1452.246484417" watchObservedRunningTime="2026-07-22 17:41:23.237177236 +0000 UTC m=+1463.253522462" Jul 22 17:41:30.622049 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.622012 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:41:30.625673 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.625650 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.627841 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.627814 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 22 17:41:30.628112 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628087 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 22 17:41:30.628112 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628110 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 22 17:41:30.628310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628122 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 22 17:41:30.628310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628123 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dwhv9\"" Jul 22 17:41:30.628310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628175 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 22 17:41:30.628435 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.628363 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 22 17:41:30.638599 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.638568 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:41:30.642295 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642268 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.642422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.642422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8bg\" (UniqueName: \"kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.642422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.642422 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.642552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.642504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743274 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743273 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8bg\" (UniqueName: \"kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:41:30.743372 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:41:30.743445 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls podName:aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3 nodeName:}" failed. No retries permitted until 2026-07-22 17:41:31.243423506 +0000 UTC m=+1471.259768711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls") pod "feast-simple-feast-setup-777d6cc998-rcjq6" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3") : secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:41:30.743451 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:41:30.743550 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:41:30.743537 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls podName:aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3 nodeName:}" failed. No retries permitted until 2026-07-22 17:41:31.243518635 +0000 UTC m=+1471.259863850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls") pod "feast-simple-feast-setup-777d6cc998-rcjq6" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3") : secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:41:30.743878 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.743795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.745947 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.745906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.746078 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.745976 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:30.751191 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:30.751152 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8bg\" (UniqueName: \"kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.246753 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.246703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.247009 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.246764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.249324 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.249291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.249455 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.249360 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rcjq6\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.544590 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.544486 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:31.682945 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:31.682899 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:41:31.685332 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:41:31.685306 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaa9f3cb_b6dd_4427_8a1e_cecc69531ea3.slice/crio-55007cf8558124d0f91a2fce5ed250a25f3659bf083cbcbb6a054b3e10291aeb WatchSource:0}: Error finding container 55007cf8558124d0f91a2fce5ed250a25f3659bf083cbcbb6a054b3e10291aeb: Status 404 returned error can't find the container with id 55007cf8558124d0f91a2fce5ed250a25f3659bf083cbcbb6a054b3e10291aeb Jul 22 17:41:32.289175 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:32.289134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"e08a44c803d3500b44938124fafc5f9dd553b6df140ac5d59578e7b5f0b12a23"} Jul 22 17:41:32.289175 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:32.289181 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"55007cf8558124d0f91a2fce5ed250a25f3659bf083cbcbb6a054b3e10291aeb"} Jul 22 17:41:37.310112 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:37.310077 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="e08a44c803d3500b44938124fafc5f9dd553b6df140ac5d59578e7b5f0b12a23" exitCode=0 Jul 22 17:41:37.310521 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:37.310153 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"e08a44c803d3500b44938124fafc5f9dd553b6df140ac5d59578e7b5f0b12a23"} Jul 22 17:41:38.315733 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:38.315699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"83688f1fe39ce0997f3d866f6f219542d4822ef5ca593a8db251b2c832951bbf"} Jul 22 17:41:43.337426 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:43.337391 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="83688f1fe39ce0997f3d866f6f219542d4822ef5ca593a8db251b2c832951bbf" exitCode=0 Jul 22 17:41:43.337819 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:43.337475 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"83688f1fe39ce0997f3d866f6f219542d4822ef5ca593a8db251b2c832951bbf"} Jul 22 17:41:44.347015 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:44.346970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"61ab5ea39c3b9509a9ed2eeaf5a7c2fe03a693b0729be6e14d9724a57d579395"} Jul 22 17:41:44.347506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:44.347035 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"b898c09da1a3623ee9b2a2c079905fff3034906a08a785c2a6a98fe1836fec51"} Jul 22 17:41:44.347506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:44.347056 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"d5ae1443f76ff94aa5372b950f3d2355bada0b4e9bf9dfe4f8957f519a0c8e04"} Jul 22 17:41:44.347506 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:44.347080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerStarted","Data":"99f2971135f196872f8db4123e5f2b645ce5fcc162af7c7be4fd53a65f5eb2a2"} Jul 22 17:41:44.374193 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:44.374127 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podStartSLOduration=14.374103323 podStartE2EDuration="14.374103323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:41:44.372491534 +0000 UTC m=+1484.388836760" watchObservedRunningTime="2026-07-22 17:41:44.374103323 +0000 UTC m=+1484.390448550" Jul 22 17:41:46.545186 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.545053 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:46.545186 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.545119 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:46.545186 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.545143 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:46.545186 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.545159 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:46.547236 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.547196 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.27:6571: connect: connection refused" Jul 22 17:41:46.547473 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.547231 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" Jul 22 17:41:46.547473 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.547232 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" Jul 22 17:41:46.547653 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:46.547305 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.27:8816: connect: connection refused" Jul 22 17:41:49.544876 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.544810 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" Jul 22 17:41:49.545967 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.545916 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.546108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.546093 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.546490 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.546465 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.546584 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.546510 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.546934 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.546895 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.547068 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.546973 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:49.551558 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:49.551535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:50.388723 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:50.388694 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:50.392124 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:50.392100 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:51.544737 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:51.544690 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:52.546236 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:52.546196 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:41:53.402036 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:41:53.402003 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:42:00.478802 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:00.478771 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:42:00.479356 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:00.478771 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:42:55.709751 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:55.709710 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:42:55.710309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:55.710070 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="registry" containerID="cri-o://99f2971135f196872f8db4123e5f2b645ce5fcc162af7c7be4fd53a65f5eb2a2" gracePeriod=30 Jul 22 17:42:55.710309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:55.710182 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" containerID="cri-o://61ab5ea39c3b9509a9ed2eeaf5a7c2fe03a693b0729be6e14d9724a57d579395" gracePeriod=30 Jul 22 17:42:55.710309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:55.710197 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" containerID="cri-o://d5ae1443f76ff94aa5372b950f3d2355bada0b4e9bf9dfe4f8957f519a0c8e04" gracePeriod=30 Jul 22 17:42:55.710309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:55.710190 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="offline" containerID="cri-o://b898c09da1a3623ee9b2a2c079905fff3034906a08a785c2a6a98fe1836fec51" gracePeriod=30 Jul 22 17:42:56.006113 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.006022 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:42:56.009895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.009868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.012168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.012140 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pqsvg\"" Jul 22 17:42:56.023318 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.023285 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:42:56.165065 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.165263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.165263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.165263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.165365 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrkg\" (UniqueName: \"kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.165365 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.165349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266182 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266352 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrkg\" (UniqueName: \"kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266352 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266352 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266352 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266565 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.266565 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:42:56.266476 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:42:56.266565 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:42:56.266483 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:42:56.266565 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:42:56.266552 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls podName:856e7d75-955d-421f-a865-12eee818e27e nodeName:}" failed. No retries permitted until 2026-07-22 17:42:56.766530823 +0000 UTC m=+1556.782876028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls") pod "feast-simple-feast-setup-777d6cc998-mxmdm" (UID: "856e7d75-955d-421f-a865-12eee818e27e") : secret "feast-simple-feast-setup-ui-tls" not found Jul 22 17:42:56.266788 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:42:56.266571 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls podName:856e7d75-955d-421f-a865-12eee818e27e nodeName:}" failed. No retries permitted until 2026-07-22 17:42:56.766561504 +0000 UTC m=+1556.782906710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls") pod "feast-simple-feast-setup-777d6cc998-mxmdm" (UID: "856e7d75-955d-421f-a865-12eee818e27e") : secret "feast-simple-feast-setup-offline-tls" not found Jul 22 17:42:56.266788 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.266546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.269219 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.269187 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.269219 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.269210 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.275752 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.275714 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrkg\" (UniqueName: \"kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.643759 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.643721 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="61ab5ea39c3b9509a9ed2eeaf5a7c2fe03a693b0729be6e14d9724a57d579395" exitCode=0 Jul 22 17:42:56.643759 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.643747 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="d5ae1443f76ff94aa5372b950f3d2355bada0b4e9bf9dfe4f8957f519a0c8e04" exitCode=0 Jul 22 17:42:56.644002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.643789 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"61ab5ea39c3b9509a9ed2eeaf5a7c2fe03a693b0729be6e14d9724a57d579395"} Jul 22 17:42:56.644002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.643831 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"d5ae1443f76ff94aa5372b950f3d2355bada0b4e9bf9dfe4f8957f519a0c8e04"} Jul 22 17:42:56.770236 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.770197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.770689 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.770264 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.772865 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.772832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.772865 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.772861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mxmdm\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:56.920189 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:56.920092 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:42:57.064533 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:57.064497 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:42:57.067520 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:42:57.067488 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod856e7d75_955d_421f_a865_12eee818e27e.slice/crio-b6649675689c426614250c5b2934707c210357f0d79583a7de640f403f852e4f WatchSource:0}: Error finding container b6649675689c426614250c5b2934707c210357f0d79583a7de640f403f852e4f: Status 404 returned error can't find the container with id b6649675689c426614250c5b2934707c210357f0d79583a7de640f403f852e4f Jul 22 17:42:57.650637 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:57.650597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb"} Jul 22 17:42:57.650637 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:42:57.650645 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"b6649675689c426614250c5b2934707c210357f0d79583a7de640f403f852e4f"} Jul 22 17:43:00.389563 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:00.389507 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" Jul 22 17:43:02.671825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:02.671728 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb" exitCode=0 Jul 22 17:43:02.671825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:02.671788 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb"} Jul 22 17:43:03.401990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:03.401912 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" Jul 22 17:43:03.677038 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:03.676914 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650"} Jul 22 17:43:09.704093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:09.704058 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650" exitCode=0 Jul 22 17:43:09.704093 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:09.704099 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650"} Jul 22 17:43:10.389518 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.388992 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" Jul 22 17:43:10.713937 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.713876 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75"} Jul 22 17:43:10.714434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.713963 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098"} Jul 22 17:43:10.714434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.713988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670"} Jul 22 17:43:10.714434 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.714009 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerStarted","Data":"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5"} Jul 22 17:43:10.742488 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:10.742408 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podStartSLOduration=15.742383111 podStartE2EDuration="15.742383111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:43:10.738984886 +0000 UTC m=+1570.755330145" watchObservedRunningTime="2026-07-22 17:43:10.742383111 +0000 UTC m=+1570.758728341" Jul 22 17:43:11.921038 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.920985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:11.921546 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.921066 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:11.921546 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.921090 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:11.921546 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.921253 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:11.923090 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.923051 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" Jul 22 17:43:11.923217 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.923102 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Jul 22 17:43:11.923217 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.923051 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" Jul 22 17:43:11.923217 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:11.923060 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Jul 22 17:43:13.402162 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:13.402099 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" Jul 22 17:43:14.920829 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:14.920781 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" Jul 22 17:43:14.921763 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:14.920781 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Jul 22 17:43:14.921910 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:14.920789 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Jul 22 17:43:14.921910 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:14.920787 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused" Jul 22 17:43:16.920375 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:16.920333 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:16.920770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:16.920407 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:16.920770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:16.920425 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:16.920770 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:16.920435 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:17.921641 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:17.921602 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:17.922216 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:17.922173 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:17.922364 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:17.922348 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:17.922467 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:17.922448 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:17.927099 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:17.927064 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:18.754140 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:18.754101 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:18.754351 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:18.754195 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:18.757185 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:18.757150 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:43:20.389159 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:20.389110 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.27:6567/health\": dial tcp 10.134.0.27:6567: connect: connection refused" Jul 22 17:43:20.389635 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:20.389235 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:43:23.401723 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:23.401666 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.27:8443: connect: connection refused" Jul 22 17:43:23.402233 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:23.401854 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:43:25.784852 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:25.784816 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="b898c09da1a3623ee9b2a2c079905fff3034906a08a785c2a6a98fe1836fec51" exitCode=137 Jul 22 17:43:25.784852 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:25.784843 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerID="99f2971135f196872f8db4123e5f2b645ce5fcc162af7c7be4fd53a65f5eb2a2" exitCode=137 Jul 22 17:43:25.785520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:25.784886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"b898c09da1a3623ee9b2a2c079905fff3034906a08a785c2a6a98fe1836fec51"} Jul 22 17:43:25.785520 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:25.784951 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"99f2971135f196872f8db4123e5f2b645ce5fcc162af7c7be4fd53a65f5eb2a2"} Jul 22 17:43:26.375502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.375471 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:43:26.431002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.430946 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431002 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431018 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh8bg\" (UniqueName: \"kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431041 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431092 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431116 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431310 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431261 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") pod \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\" (UID: \"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3\") " Jul 22 17:43:26.431724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.431691 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data" (OuterVolumeSpecName: "feast-data") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:43:26.433526 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.433496 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls" (OuterVolumeSpecName: "online-tls") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:43:26.433656 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.433540 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg" (OuterVolumeSpecName: "kube-api-access-qh8bg") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "kube-api-access-qh8bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:43:26.433656 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.433561 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:43:26.433755 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.433711 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:43:26.433795 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.433756 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" (UID: "aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532179 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532227 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh8bg\" (UniqueName: \"kubernetes.io/projected/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-kube-api-access-qh8bg\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532238 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532247 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532255 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.532284 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.532263 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:43:26.791535 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.791428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" event={"ID":"aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3","Type":"ContainerDied","Data":"55007cf8558124d0f91a2fce5ed250a25f3659bf083cbcbb6a054b3e10291aeb"} Jul 22 17:43:26.791535 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.791461 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6" Jul 22 17:43:26.791535 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.791504 2582 scope.go:117] "RemoveContainer" containerID="61ab5ea39c3b9509a9ed2eeaf5a7c2fe03a693b0729be6e14d9724a57d579395" Jul 22 17:43:26.800646 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.800626 2582 scope.go:117] "RemoveContainer" containerID="b898c09da1a3623ee9b2a2c079905fff3034906a08a785c2a6a98fe1836fec51" Jul 22 17:43:26.808207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.808174 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:43:26.809568 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.809546 2582 scope.go:117] "RemoveContainer" containerID="d5ae1443f76ff94aa5372b950f3d2355bada0b4e9bf9dfe4f8957f519a0c8e04" Jul 22 17:43:26.814344 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.814323 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rcjq6"] Jul 22 17:43:26.817871 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.817841 2582 scope.go:117] "RemoveContainer" containerID="99f2971135f196872f8db4123e5f2b645ce5fcc162af7c7be4fd53a65f5eb2a2" Jul 22 17:43:26.825823 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.825803 2582 scope.go:117] "RemoveContainer" containerID="83688f1fe39ce0997f3d866f6f219542d4822ef5ca593a8db251b2c832951bbf" Jul 22 17:43:26.833746 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:26.833725 2582 scope.go:117] "RemoveContainer" containerID="e08a44c803d3500b44938124fafc5f9dd553b6df140ac5d59578e7b5f0b12a23" Jul 22 17:43:28.554679 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:43:28.554643 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" path="/var/lib/kubelet/pods/aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3/volumes" Jul 22 17:44:21.328802 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.328758 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329070 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="registry" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329083 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="registry" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329099 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="feast-init" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329105 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="feast-init" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329112 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="feast-apply" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329119 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="feast-apply" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329127 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329134 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329142 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329147 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329158 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="offline" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329163 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="offline" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329205 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="offline" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329213 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="ui" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329222 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="online" Jul 22 17:44:21.329308 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.329228 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa9f3cb-b6dd-4427-8a1e-cecc69531ea3" containerName="registry" Jul 22 17:44:21.333839 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.333811 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.336117 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 22 17:44:21.336285 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336093 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 22 17:44:21.336285 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336157 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 22 17:44:21.336285 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336256 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 22 17:44:21.336497 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-tgrrw\"" Jul 22 17:44:21.336772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336756 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 22 17:44:21.336772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.336757 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 22 17:44:21.344546 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.344522 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:44:21.368589 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.368548 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.372660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.368873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.372660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.368963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.372660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.369003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.372660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.369036 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd7rc\" (UniqueName: \"kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.372660 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.369139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469656 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469656 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469657 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd7rc\" (UniqueName: \"kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:44:21.469811 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.469836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:44:21.469813 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 22 17:44:21.469971 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:44:21.469909 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls podName:f0ebdd60-434b-4586-8f11-a5ab13defb9b nodeName:}" failed. No retries permitted until 2026-07-22 17:44:21.96988402 +0000 UTC m=+1641.986229242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls") pod "feast-simple-feast-remote-setup-db6955c6c-cqx8v" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b") : secret "feast-simple-feast-remote-setup-online-tls" not found Jul 22 17:44:21.470272 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:44:21.470006 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls podName:f0ebdd60-434b-4586-8f11-a5ab13defb9b nodeName:}" failed. No retries permitted until 2026-07-22 17:44:21.969983008 +0000 UTC m=+1641.986328221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-cqx8v" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 22 17:44:21.470316 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.470288 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.470572 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.470547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.472472 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.472454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.480500 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.480471 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd7rc\" (UniqueName: \"kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.974475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.974430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.974475 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.974477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.977087 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.977062 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:21.977165 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:21.977090 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cqx8v\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:22.244669 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:22.244559 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:22.387601 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:22.387576 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:44:22.389785 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:44:22.389753 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0ebdd60_434b_4586_8f11_a5ab13defb9b.slice/crio-1ad5c62a702b4ae0ba137a003db82c35bcd1641ffb1c8c2e4ce48c0ffe6fd715 WatchSource:0}: Error finding container 1ad5c62a702b4ae0ba137a003db82c35bcd1641ffb1c8c2e4ce48c0ffe6fd715: Status 404 returned error can't find the container with id 1ad5c62a702b4ae0ba137a003db82c35bcd1641ffb1c8c2e4ce48c0ffe6fd715 Jul 22 17:44:23.008961 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:23.008904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"749c6ac7f5f02a3a901ed7ba236666df67a86129e1e189c6201547324ba1558c"} Jul 22 17:44:23.008961 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:23.008962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"1ad5c62a702b4ae0ba137a003db82c35bcd1641ffb1c8c2e4ce48c0ffe6fd715"} Jul 22 17:44:28.030159 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:28.030119 2582 generic.go:356] "Generic (PLEG): container finished" podID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerID="749c6ac7f5f02a3a901ed7ba236666df67a86129e1e189c6201547324ba1558c" exitCode=0 Jul 22 17:44:28.030608 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:28.030193 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"749c6ac7f5f02a3a901ed7ba236666df67a86129e1e189c6201547324ba1558c"} Jul 22 17:44:29.036228 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:29.036179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"0ffb95c2faf7f5540cd32174f205013924f40e96837cd54a4b9fac7dce471fe4"} Jul 22 17:44:35.062979 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:35.062939 2582 generic.go:356] "Generic (PLEG): container finished" podID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerID="0ffb95c2faf7f5540cd32174f205013924f40e96837cd54a4b9fac7dce471fe4" exitCode=0 Jul 22 17:44:35.062979 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:35.062965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"0ffb95c2faf7f5540cd32174f205013924f40e96837cd54a4b9fac7dce471fe4"} Jul 22 17:44:36.072272 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:36.072235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"06ae708e656b106ba8d9a393423db4495f13487c7938385eff62ad65b0fed765"} Jul 22 17:44:36.072825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:36.072290 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"59f16b0ee87e66d690f44ac5da0cae153172544fd41b4549aebae4ac2a9a991f"} Jul 22 17:44:36.072825 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:36.072305 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerStarted","Data":"6c5e30a2207e6d27286942311625fc1561e8588658568df8b608ec461d1ad6b6"} Jul 22 17:44:36.093902 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:36.093837 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podStartSLOduration=15.093815272 podStartE2EDuration="15.093815272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:44:36.092232222 +0000 UTC m=+1656.108577522" watchObservedRunningTime="2026-07-22 17:44:36.093815272 +0000 UTC m=+1656.110160500" Jul 22 17:44:37.245008 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.244960 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:37.245541 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.245034 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:37.245541 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.245054 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:37.246783 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.246734 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused" Jul 22 17:44:37.246783 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.246759 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.29:8816: connect: connection refused" Jul 22 17:44:37.247018 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:37.246781 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Jul 22 17:44:40.245192 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:40.245128 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused" Jul 22 17:44:40.245736 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:40.245121 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.29:8816: connect: connection refused" Jul 22 17:44:40.245736 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:40.245227 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Jul 22 17:44:42.245052 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:42.245012 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:42.245513 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:42.245086 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:42.245513 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:42.245099 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:43.246186 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:43.246155 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:43.246626 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:43.246276 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:43.246999 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:43.246970 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:43.247120 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:43.247034 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:43.253198 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:43.253171 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:44:44.115612 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:44:44.115580 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:45:46.311965 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.311912 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:45:46.312585 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.312285 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" containerID="cri-o://6c5e30a2207e6d27286942311625fc1561e8588658568df8b608ec461d1ad6b6" gracePeriod=30 Jul 22 17:45:46.312585 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.312317 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" containerID="cri-o://59f16b0ee87e66d690f44ac5da0cae153172544fd41b4549aebae4ac2a9a991f" gracePeriod=30 Jul 22 17:45:46.312585 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.312347 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" containerID="cri-o://06ae708e656b106ba8d9a393423db4495f13487c7938385eff62ad65b0fed765" gracePeriod=30 Jul 22 17:45:46.473598 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.473547 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:45:46.473878 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.473839 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" containerID="cri-o://c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" gracePeriod=30 Jul 22 17:45:46.474259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.474228 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" containerID="cri-o://97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" gracePeriod=30 Jul 22 17:45:46.474519 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.474272 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" containerID="cri-o://4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" gracePeriod=30 Jul 22 17:45:46.474698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:46.474323 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" containerID="cri-o://955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" gracePeriod=30 Jul 22 17:45:47.368792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.368747 2582 generic.go:356] "Generic (PLEG): container finished" podID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerID="06ae708e656b106ba8d9a393423db4495f13487c7938385eff62ad65b0fed765" exitCode=0 Jul 22 17:45:47.368792 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.368775 2582 generic.go:356] "Generic (PLEG): container finished" podID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerID="6c5e30a2207e6d27286942311625fc1561e8588658568df8b608ec461d1ad6b6" exitCode=0 Jul 22 17:45:47.369339 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.368821 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"06ae708e656b106ba8d9a393423db4495f13487c7938385eff62ad65b0fed765"} Jul 22 17:45:47.369339 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.368867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"6c5e30a2207e6d27286942311625fc1561e8588658568df8b608ec461d1ad6b6"} Jul 22 17:45:47.371818 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.371789 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" exitCode=0 Jul 22 17:45:47.371818 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.371816 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" exitCode=0 Jul 22 17:45:47.372011 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.371832 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75"} Jul 22 17:45:47.372011 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:47.371872 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670"} Jul 22 17:45:48.754752 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:48.754704 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Jul 22 17:45:48.755251 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:48.754700 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" Jul 22 17:45:53.247369 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:53.247319 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused" Jul 22 17:45:54.110809 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:54.110762 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Jul 22 17:45:58.754143 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:58.754091 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" Jul 22 17:45:58.754636 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:45:58.754102 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Jul 22 17:46:03.246845 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:03.246799 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused" Jul 22 17:46:04.110842 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:04.110791 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Jul 22 17:46:08.753724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:08.753673 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.28:8443: connect: connection refused" Jul 22 17:46:08.753724 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:08.753673 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Jul 22 17:46:08.754266 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:08.753823 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:46:08.754266 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:08.753884 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:46:13.247097 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:13.247046 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.29:8443: connect: connection refused" Jul 22 17:46:13.247568 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:13.247192 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:46:14.111214 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:14.111169 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Jul 22 17:46:14.111417 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:14.111310 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:46:16.496464 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:16.496233 2582 generic.go:356] "Generic (PLEG): container finished" podID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerID="59f16b0ee87e66d690f44ac5da0cae153172544fd41b4549aebae4ac2a9a991f" exitCode=137 Jul 22 17:46:16.496464 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:16.496297 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"59f16b0ee87e66d690f44ac5da0cae153172544fd41b4549aebae4ac2a9a991f"} Jul 22 17:46:16.969259 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:16.969232 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:46:17.079118 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079027 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd7rc\" (UniqueName: \"kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079118 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079095 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079125 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079161 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079232 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079403 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079260 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data\") pod \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\" (UID: \"f0ebdd60-434b-4586-8f11-a5ab13defb9b\") " Jul 22 17:46:17.079759 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.079723 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 17:46:17.080125 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.080097 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data" (OuterVolumeSpecName: "feast-data") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:46:17.081567 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.081545 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.081772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.081735 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc" (OuterVolumeSpecName: "kube-api-access-kd7rc") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "kube-api-access-kd7rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:46:17.081772 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.081759 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.081970 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.081953 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls" (OuterVolumeSpecName: "online-tls") pod "f0ebdd60-434b-4586-8f11-a5ab13defb9b" (UID: "f0ebdd60-434b-4586-8f11-a5ab13defb9b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.128069 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.128041 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:46:17.180299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180258 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.180299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180289 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0ebdd60-434b-4586-8f11-a5ab13defb9b-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.180299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180298 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.180299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180306 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0ebdd60-434b-4586-8f11-a5ab13defb9b-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.180299 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180313 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ebdd60-434b-4586-8f11-a5ab13defb9b-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.180619 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.180321 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd7rc\" (UniqueName: \"kubernetes.io/projected/f0ebdd60-434b-4586-8f11-a5ab13defb9b-kube-api-access-kd7rc\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.280886 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.280846 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281102 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.280906 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgrkg\" (UniqueName: \"kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281102 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.280949 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281102 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.280962 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281102 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.281014 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281102 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.281031 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data\") pod \"856e7d75-955d-421f-a865-12eee818e27e\" (UID: \"856e7d75-955d-421f-a865-12eee818e27e\") " Jul 22 17:46:17.281761 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.281725 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data" (OuterVolumeSpecName: "feast-data") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:46:17.283221 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.283194 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.283338 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.283224 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.283338 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.283235 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.283495 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.283479 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls" (OuterVolumeSpecName: "online-tls") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 17:46:17.283537 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.283492 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg" (OuterVolumeSpecName: "kube-api-access-kgrkg") pod "856e7d75-955d-421f-a865-12eee818e27e" (UID: "856e7d75-955d-421f-a865-12eee818e27e"). InnerVolumeSpecName "kube-api-access-kgrkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:46:17.382634 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.382526 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-registry-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.382898 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.382868 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgrkg\" (UniqueName: \"kubernetes.io/projected/856e7d75-955d-421f-a865-12eee818e27e-kube-api-access-kgrkg\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.383019 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.383007 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-offline-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.383101 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.383091 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-ui-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.383177 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.383167 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856e7d75-955d-421f-a865-12eee818e27e-online-tls\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.383335 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.383324 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856e7d75-955d-421f-a865-12eee818e27e-feast-data\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:17.503669 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.503623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" event={"ID":"f0ebdd60-434b-4586-8f11-a5ab13defb9b","Type":"ContainerDied","Data":"1ad5c62a702b4ae0ba137a003db82c35bcd1641ffb1c8c2e4ce48c0ffe6fd715"} Jul 22 17:46:17.503669 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.503660 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v" Jul 22 17:46:17.504226 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.503687 2582 scope.go:117] "RemoveContainer" containerID="06ae708e656b106ba8d9a393423db4495f13487c7938385eff62ad65b0fed765" Jul 22 17:46:17.506842 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506811 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" exitCode=137 Jul 22 17:46:17.506842 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506842 2582 generic.go:356] "Generic (PLEG): container finished" podID="856e7d75-955d-421f-a865-12eee818e27e" containerID="c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" exitCode=137 Jul 22 17:46:17.507023 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506891 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" Jul 22 17:46:17.507023 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506890 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098"} Jul 22 17:46:17.507023 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5"} Jul 22 17:46:17.507023 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.506989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm" event={"ID":"856e7d75-955d-421f-a865-12eee818e27e","Type":"ContainerDied","Data":"b6649675689c426614250c5b2934707c210357f0d79583a7de640f403f852e4f"} Jul 22 17:46:17.513360 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.513152 2582 scope.go:117] "RemoveContainer" containerID="59f16b0ee87e66d690f44ac5da0cae153172544fd41b4549aebae4ac2a9a991f" Jul 22 17:46:17.521764 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.521742 2582 scope.go:117] "RemoveContainer" containerID="6c5e30a2207e6d27286942311625fc1561e8588658568df8b608ec461d1ad6b6" Jul 22 17:46:17.529065 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.529035 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:46:17.530860 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.530839 2582 scope.go:117] "RemoveContainer" containerID="0ffb95c2faf7f5540cd32174f205013924f40e96837cd54a4b9fac7dce471fe4" Jul 22 17:46:17.535079 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.535056 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cqx8v"] Jul 22 17:46:17.538776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.538757 2582 scope.go:117] "RemoveContainer" containerID="749c6ac7f5f02a3a901ed7ba236666df67a86129e1e189c6201547324ba1558c" Jul 22 17:46:17.545552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.545524 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:46:17.549807 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.549782 2582 scope.go:117] "RemoveContainer" containerID="97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" Jul 22 17:46:17.550891 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.550865 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mxmdm"] Jul 22 17:46:17.558202 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.558183 2582 scope.go:117] "RemoveContainer" containerID="955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" Jul 22 17:46:17.565663 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.565645 2582 scope.go:117] "RemoveContainer" containerID="4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" Jul 22 17:46:17.573124 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.573105 2582 scope.go:117] "RemoveContainer" containerID="c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" Jul 22 17:46:17.580601 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.580580 2582 scope.go:117] "RemoveContainer" containerID="e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650" Jul 22 17:46:17.588407 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.588388 2582 scope.go:117] "RemoveContainer" containerID="1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb" Jul 22 17:46:17.596168 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.596145 2582 scope.go:117] "RemoveContainer" containerID="97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" Jul 22 17:46:17.596450 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.596432 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75\": container with ID starting with 97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75 not found: ID does not exist" containerID="97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" Jul 22 17:46:17.596502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.596460 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75"} err="failed to get container status \"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75\": rpc error: code = NotFound desc = could not find container \"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75\": container with ID starting with 97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75 not found: ID does not exist" Jul 22 17:46:17.596502 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.596478 2582 scope.go:117] "RemoveContainer" containerID="955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" Jul 22 17:46:17.596712 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.596690 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098\": container with ID starting with 955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098 not found: ID does not exist" containerID="955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" Jul 22 17:46:17.596776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.596720 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098"} err="failed to get container status \"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098\": rpc error: code = NotFound desc = could not find container \"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098\": container with ID starting with 955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098 not found: ID does not exist" Jul 22 17:46:17.596776 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.596743 2582 scope.go:117] "RemoveContainer" containerID="4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" Jul 22 17:46:17.597038 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.597020 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670\": container with ID starting with 4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670 not found: ID does not exist" containerID="4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" Jul 22 17:46:17.597105 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597042 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670"} err="failed to get container status \"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670\": rpc error: code = NotFound desc = could not find container \"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670\": container with ID starting with 4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670 not found: ID does not exist" Jul 22 17:46:17.597105 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597058 2582 scope.go:117] "RemoveContainer" containerID="c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" Jul 22 17:46:17.597278 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.597263 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5\": container with ID starting with c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5 not found: ID does not exist" containerID="c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" Jul 22 17:46:17.597319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597279 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5"} err="failed to get container status \"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5\": rpc error: code = NotFound desc = could not find container \"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5\": container with ID starting with c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5 not found: ID does not exist" Jul 22 17:46:17.597319 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597291 2582 scope.go:117] "RemoveContainer" containerID="e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650" Jul 22 17:46:17.597564 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.597546 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650\": container with ID starting with e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650 not found: ID does not exist" containerID="e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650" Jul 22 17:46:17.597602 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597568 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650"} err="failed to get container status \"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650\": rpc error: code = NotFound desc = could not find container \"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650\": container with ID starting with e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650 not found: ID does not exist" Jul 22 17:46:17.597602 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597584 2582 scope.go:117] "RemoveContainer" containerID="1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb" Jul 22 17:46:17.597847 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:17.597824 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb\": container with ID starting with 1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb not found: ID does not exist" containerID="1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb" Jul 22 17:46:17.597889 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597852 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb"} err="failed to get container status \"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb\": rpc error: code = NotFound desc = could not find container \"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb\": container with ID starting with 1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb not found: ID does not exist" Jul 22 17:46:17.597889 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.597871 2582 scope.go:117] "RemoveContainer" containerID="97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75" Jul 22 17:46:17.598116 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598099 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75"} err="failed to get container status \"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75\": rpc error: code = NotFound desc = could not find container \"97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75\": container with ID starting with 97f85255462d02bd799cb25028ad18290c464cc01e7510545d55092616f59c75 not found: ID does not exist" Jul 22 17:46:17.598161 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598118 2582 scope.go:117] "RemoveContainer" containerID="955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098" Jul 22 17:46:17.598339 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598315 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098"} err="failed to get container status \"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098\": rpc error: code = NotFound desc = could not find container \"955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098\": container with ID starting with 955c1861173747b1ff208868452c55d4418ada4b799de4e9ecaea6d5a7cc1098 not found: ID does not exist" Jul 22 17:46:17.598387 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598340 2582 scope.go:117] "RemoveContainer" containerID="4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670" Jul 22 17:46:17.598580 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598563 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670"} err="failed to get container status \"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670\": rpc error: code = NotFound desc = could not find container \"4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670\": container with ID starting with 4c227c5103d824c1bef59e9765bdceda8c2eaec13a5f6a6d499b6b9a65194670 not found: ID does not exist" Jul 22 17:46:17.598580 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598579 2582 scope.go:117] "RemoveContainer" containerID="c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5" Jul 22 17:46:17.598858 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598841 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5"} err="failed to get container status \"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5\": rpc error: code = NotFound desc = could not find container \"c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5\": container with ID starting with c5bb19dcb651913ce8e0b6ad97cc92f4968cf2ef7f8e2bcb417705ad5d5deff5 not found: ID does not exist" Jul 22 17:46:17.598901 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.598859 2582 scope.go:117] "RemoveContainer" containerID="e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650" Jul 22 17:46:17.599092 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.599076 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650"} err="failed to get container status \"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650\": rpc error: code = NotFound desc = could not find container \"e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650\": container with ID starting with e1fa24a70f19d370c9c762bffacfdf29b45fe49bda82f1ed56002d133b49e650 not found: ID does not exist" Jul 22 17:46:17.599153 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.599092 2582 scope.go:117] "RemoveContainer" containerID="1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb" Jul 22 17:46:17.599282 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:17.599266 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb"} err="failed to get container status \"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb\": rpc error: code = NotFound desc = could not find container \"1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb\": container with ID starting with 1af7c6b168b01bb90dd6b90232e9ec07b806a3652834a3cba47df6b7bb5ba8bb not found: ID does not exist" Jul 22 17:46:18.555194 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:18.555160 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856e7d75-955d-421f-a865-12eee818e27e" path="/var/lib/kubelet/pods/856e7d75-955d-421f-a865-12eee818e27e/volumes" Jul 22 17:46:18.555771 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:18.555757 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" path="/var/lib/kubelet/pods/f0ebdd60-434b-4586-8f11-a5ab13defb9b/volumes" Jul 22 17:46:35.507190 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507145 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xkx45/must-gather-49sx4"] Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507536 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507554 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507577 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507587 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507595 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="feast-init" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507603 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="feast-init" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507613 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507620 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507628 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507635 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507643 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="feast-apply" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507650 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="feast-apply" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507660 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507668 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507679 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="feast-apply" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507687 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="feast-apply" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507697 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" Jul 22 17:46:35.507698 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507705 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507713 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507721 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507731 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="feast-init" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507739 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="feast-init" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507807 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="ui" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507818 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="ui" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507828 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="offline" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507835 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="online" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507845 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="registry" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507853 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="856e7d75-955d-421f-a865-12eee818e27e" containerName="online" Jul 22 17:46:35.508595 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.507861 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ebdd60-434b-4586-8f11-a5ab13defb9b" containerName="offline" Jul 22 17:46:35.511022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.511000 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.513309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.513282 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkx45\"/\"openshift-service-ca.crt\"" Jul 22 17:46:35.513309 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.513287 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkx45\"/\"kube-root-ca.crt\"" Jul 22 17:46:35.513533 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.513352 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xkx45\"/\"default-dockercfg-w6kb8\"" Jul 22 17:46:35.519552 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.519522 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkx45/must-gather-49sx4"] Jul 22 17:46:35.632823 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.632777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.633024 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.632837 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bvb\" (UniqueName: \"kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.734109 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.734064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.734280 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.734143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bvb\" (UniqueName: \"kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.734441 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.734422 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.743203 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.743175 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bvb\" (UniqueName: \"kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb\") pod \"must-gather-49sx4\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.828108 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.828020 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:35.961082 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.961037 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkx45/must-gather-49sx4"] Jul 22 17:46:35.964280 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:46:35.964240 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a64c4ec_c7ca_4f16_8e91_d450730949c6.slice/crio-0cbf337ebc935716ac99adf90e7762d756acc95b5af6ac965144e9f3802a62a8 WatchSource:0}: Error finding container 0cbf337ebc935716ac99adf90e7762d756acc95b5af6ac965144e9f3802a62a8: Status 404 returned error can't find the container with id 0cbf337ebc935716ac99adf90e7762d756acc95b5af6ac965144e9f3802a62a8 Jul 22 17:46:35.970687 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:35.970583 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 17:46:36.579356 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:36.579315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkx45/must-gather-49sx4" event={"ID":"9a64c4ec-c7ca-4f16-8e91-d450730949c6","Type":"ContainerStarted","Data":"0cbf337ebc935716ac99adf90e7762d756acc95b5af6ac965144e9f3802a62a8"} Jul 22 17:46:42.612503 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:42.612447 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkx45/must-gather-49sx4" event={"ID":"9a64c4ec-c7ca-4f16-8e91-d450730949c6","Type":"ContainerStarted","Data":"a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374"} Jul 22 17:46:42.612874 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:42.612523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkx45/must-gather-49sx4" event={"ID":"9a64c4ec-c7ca-4f16-8e91-d450730949c6","Type":"ContainerStarted","Data":"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a"} Jul 22 17:46:42.628783 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:42.628727 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xkx45/must-gather-49sx4" podStartSLOduration=1.508027818 podStartE2EDuration="7.62870736s" totalImagesPullingTime="6.120679542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:46:42.627386607 +0000 UTC m=+1782.643731833" watchObservedRunningTime="2026-07-22 17:46:42.62870736 +0000 UTC m=+1782.645052584" Jul 22 17:46:52.651488 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:52.651448 2582 generic.go:356] "Generic (PLEG): container finished" podID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerID="ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a" exitCode=0 Jul 22 17:46:52.652054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:52.651523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkx45/must-gather-49sx4" event={"ID":"9a64c4ec-c7ca-4f16-8e91-d450730949c6","Type":"ContainerDied","Data":"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a"} Jul 22 17:46:52.652054 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:52.651877 2582 scope.go:117] "RemoveContainer" containerID="ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a" Jul 22 17:46:52.955050 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:52.955015 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkx45_must-gather-49sx4_9a64c4ec-c7ca-4f16-8e91-d450730949c6/gather/0.log" Jul 22 17:46:56.106466 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:56.106420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tcq4h_d42dbc1c-eaaf-44db-a51e-50877be12332/global-pull-secret-syncer/0.log" Jul 22 17:46:56.223815 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:56.223783 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vwndh_5929ab95-84c7-49e8-99b9-5f795fdeb554/konnectivity-agent/0.log" Jul 22 17:46:56.269055 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:56.269004 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-17.ec2.internal_38d375f9e4eff9d7cd26e8a8abd987f9/haproxy/0.log" Jul 22 17:46:58.273207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.273171 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xkx45/must-gather-49sx4"] Jul 22 17:46:58.273675 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.273381 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xkx45/must-gather-49sx4" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="copy" containerID="cri-o://a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374" gracePeriod=2 Jul 22 17:46:58.277584 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.277109 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xkx45/must-gather-49sx4"] Jul 22 17:46:58.513844 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.513816 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkx45_must-gather-49sx4_9a64c4ec-c7ca-4f16-8e91-d450730949c6/copy/0.log" Jul 22 17:46:58.515377 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.515350 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:58.517029 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:58.516993 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-49sx4\" is forbidden: User \"system:node:ip-10-0-134-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xkx45\": no relationship found between node 'ip-10-0-134-17.ec2.internal' and this object" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:58.626015 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.625973 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output\") pod \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " Jul 22 17:46:58.626015 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.626022 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2bvb\" (UniqueName: \"kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb\") pod \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\" (UID: \"9a64c4ec-c7ca-4f16-8e91-d450730949c6\") " Jul 22 17:46:58.626372 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.626347 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9a64c4ec-c7ca-4f16-8e91-d450730949c6" (UID: "9a64c4ec-c7ca-4f16-8e91-d450730949c6"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 17:46:58.628395 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.628372 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb" (OuterVolumeSpecName: "kube-api-access-b2bvb") pod "9a64c4ec-c7ca-4f16-8e91-d450730949c6" (UID: "9a64c4ec-c7ca-4f16-8e91-d450730949c6"). InnerVolumeSpecName "kube-api-access-b2bvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 17:46:58.675594 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.675496 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xkx45_must-gather-49sx4_9a64c4ec-c7ca-4f16-8e91-d450730949c6/copy/0.log" Jul 22 17:46:58.675870 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.675841 2582 generic.go:356] "Generic (PLEG): container finished" podID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerID="a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374" exitCode=143 Jul 22 17:46:58.675946 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.675897 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkx45/must-gather-49sx4" Jul 22 17:46:58.675990 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.675900 2582 scope.go:117] "RemoveContainer" containerID="a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374" Jul 22 17:46:58.684210 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.684188 2582 scope.go:117] "RemoveContainer" containerID="ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a" Jul 22 17:46:58.695956 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.695931 2582 scope.go:117] "RemoveContainer" containerID="a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374" Jul 22 17:46:58.696293 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:58.696275 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374\": container with ID starting with a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374 not found: ID does not exist" containerID="a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374" Jul 22 17:46:58.696351 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.696303 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374"} err="failed to get container status \"a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374\": rpc error: code = NotFound desc = could not find container \"a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374\": container with ID starting with a7838c8dc1c8b157169127c3fa1bbb34d999f111ff6467f54f28338f8751b374 not found: ID does not exist" Jul 22 17:46:58.696351 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.696323 2582 scope.go:117] "RemoveContainer" containerID="ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a" Jul 22 17:46:58.696591 ip-10-0-134-17 kubenswrapper[2582]: E0722 17:46:58.696569 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a\": container with ID starting with ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a not found: ID does not exist" containerID="ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a" Jul 22 17:46:58.696668 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.696602 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a"} err="failed to get container status \"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a\": rpc error: code = NotFound desc = could not find container \"ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a\": container with ID starting with ada41dda1f21ee44281c836561dcec28a678788ae7706aca649430a036a1587a not found: ID does not exist" Jul 22 17:46:58.726808 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.726773 2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a64c4ec-c7ca-4f16-8e91-d450730949c6-must-gather-output\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:58.726808 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:58.726806 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2bvb\" (UniqueName: \"kubernetes.io/projected/9a64c4ec-c7ca-4f16-8e91-d450730949c6-kube-api-access-b2bvb\") on node \"ip-10-0-134-17.ec2.internal\" DevicePath \"\"" Jul 22 17:46:59.697371 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.697339 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/alertmanager/0.log" Jul 22 17:46:59.734183 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.734151 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/config-reloader/0.log" Jul 22 17:46:59.765877 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.765852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/kube-rbac-proxy-web/0.log" Jul 22 17:46:59.799379 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.799352 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/kube-rbac-proxy/0.log" Jul 22 17:46:59.842817 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.842779 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/kube-rbac-proxy-metric/0.log" Jul 22 17:46:59.872986 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.872954 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/prom-label-proxy/0.log" Jul 22 17:46:59.899405 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.899379 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f8a94a4-8127-4474-97a3-31ffb9965b37/init-config-reloader/0.log" Jul 22 17:46:59.984423 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:46:59.984292 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r5blj_abe89825-5816-4984-9ff0-bcda28c80bf6/kube-state-metrics/0.log" Jul 22 17:47:00.009535 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.009461 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r5blj_abe89825-5816-4984-9ff0-bcda28c80bf6/kube-rbac-proxy-main/0.log" Jul 22 17:47:00.045075 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.045025 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r5blj_abe89825-5816-4984-9ff0-bcda28c80bf6/kube-rbac-proxy-self/0.log" Jul 22 17:47:00.124626 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.124587 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-qf6l8_1d8018fe-6db7-48c1-ad2e-28695dd0b24d/monitoring-plugin/0.log" Jul 22 17:47:00.315649 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.315564 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nktgt_3640e25b-4694-464c-95f7-2dfd01e43a43/node-exporter/0.log" Jul 22 17:47:00.338146 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.338114 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nktgt_3640e25b-4694-464c-95f7-2dfd01e43a43/kube-rbac-proxy/0.log" Jul 22 17:47:00.359902 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.359872 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nktgt_3640e25b-4694-464c-95f7-2dfd01e43a43/init-textfile/0.log" Jul 22 17:47:00.504473 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.504444 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:47:00.504682 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.504608 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:47:00.555267 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.555222 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" path="/var/lib/kubelet/pods/9a64c4ec-c7ca-4f16-8e91-d450730949c6/volumes" Jul 22 17:47:00.660181 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.660095 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-j5q7p_a3359d6a-4a12-427a-b8c4-7885d80ad2fc/prometheus-operator/0.log" Jul 22 17:47:00.687125 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:00.687096 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-j5q7p_a3359d6a-4a12-427a-b8c4-7885d80ad2fc/kube-rbac-proxy/0.log" Jul 22 17:47:03.164385 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.164291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65786f966b-ggbcr_d582da68-e3d2-4723-a395-7ebf57d61813/console/0.log" Jul 22 17:47:03.855986 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.855951 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt"] Jul 22 17:47:03.856339 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856316 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="gather" Jul 22 17:47:03.856423 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856343 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="gather" Jul 22 17:47:03.856423 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856361 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="copy" Jul 22 17:47:03.856423 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856369 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="copy" Jul 22 17:47:03.856563 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856447 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="gather" Jul 22 17:47:03.856563 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.856463 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a64c4ec-c7ca-4f16-8e91-d450730949c6" containerName="copy" Jul 22 17:47:03.858337 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.858317 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:03.860328 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.860296 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whdwt\"/\"openshift-service-ca.crt\"" Jul 22 17:47:03.860462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.860343 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whdwt\"/\"kube-root-ca.crt\"" Jul 22 17:47:03.860462 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.860452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whdwt\"/\"default-dockercfg-mtb86\"" Jul 22 17:47:03.873364 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.871896 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt"] Jul 22 17:47:03.973679 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.973633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-podres\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:03.973872 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.973696 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-sys\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:03.973872 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.973743 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69687\" (UniqueName: \"kubernetes.io/projected/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-kube-api-access-69687\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:03.973872 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.973806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-proc\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:03.973872 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:03.973850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-lib-modules\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.074868 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.074825 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-podres\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.074881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-sys\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075022 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.074959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69687\" (UniqueName: \"kubernetes.io/projected/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-kube-api-access-69687\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075091 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075034 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-proc\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075091 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075056 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-podres\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075091 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075080 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-proc\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075195 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-lib-modules\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075195 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075039 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-sys\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.075260 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.075223 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-lib-modules\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.082781 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.082746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69687\" (UniqueName: \"kubernetes.io/projected/c0886e7e-8400-4b82-af32-cf8b7e1b9f6a-kube-api-access-69687\") pod \"perf-node-gather-daemonset-lqgzt\" (UID: \"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a\") " pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.168100 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.168004 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.298794 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.298666 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt"] Jul 22 17:47:04.301505 ip-10-0-134-17 kubenswrapper[2582]: W0722 17:47:04.301473 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0886e7e_8400_4b82_af32_cf8b7e1b9f6a.slice/crio-a7759d334c474e9cc694339c48e35201001ab6f12ff415204ba854500c659286 WatchSource:0}: Error finding container a7759d334c474e9cc694339c48e35201001ab6f12ff415204ba854500c659286: Status 404 returned error can't find the container with id a7759d334c474e9cc694339c48e35201001ab6f12ff415204ba854500c659286 Jul 22 17:47:04.549342 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.549289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c4vh4_f196aa45-596e-456e-b5a8-78883e5afba0/dns/0.log" Jul 22 17:47:04.571249 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.571215 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c4vh4_f196aa45-596e-456e-b5a8-78883e5afba0/kube-rbac-proxy/0.log" Jul 22 17:47:04.700665 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.700625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" event={"ID":"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a","Type":"ContainerStarted","Data":"5bd2e374294bd865e9cab8820f69899e8e6291b2e16b680e6d735acd93affd2b"} Jul 22 17:47:04.700895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.700683 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" event={"ID":"c0886e7e-8400-4b82-af32-cf8b7e1b9f6a","Type":"ContainerStarted","Data":"a7759d334c474e9cc694339c48e35201001ab6f12ff415204ba854500c659286"} Jul 22 17:47:04.700895 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.700774 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:04.716145 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.716088 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" podStartSLOduration=1.7160689150000001 podStartE2EDuration="1.716068915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 17:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 17:47:04.714845605 +0000 UTC m=+1804.731190844" watchObservedRunningTime="2026-07-22 17:47:04.716068915 +0000 UTC m=+1804.732414182" Jul 22 17:47:04.729263 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:04.729235 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wf9ml_7b4d76be-c869-4a60-8df1-0e96de9654ed/dns-node-resolver/0.log" Jul 22 17:47:05.155965 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:05.155850 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-678b96d48c-zpfrz_dbe75056-fd3e-4945-bb17-026ca74b45a1/registry/0.log" Jul 22 17:47:05.177359 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:05.177330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s52n_465ab9d1-327f-41fb-ac50-975f7d37ab23/node-ca/0.log" Jul 22 17:47:06.194556 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:06.194526 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7frk7_4c7e4c78-d1f7-402a-b9ac-422077891d51/serve-healthcheck-canary/0.log" Jul 22 17:47:06.733258 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:06.733226 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zffcd_da17968e-0310-4555-9b44-a45a5fa124c8/kube-rbac-proxy/0.log" Jul 22 17:47:06.755634 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:06.755606 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zffcd_da17968e-0310-4555-9b44-a45a5fa124c8/exporter/0.log" Jul 22 17:47:06.779207 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:06.779176 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zffcd_da17968e-0310-4555-9b44-a45a5fa124c8/extractor/0.log" Jul 22 17:47:10.715087 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:10.715055 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whdwt/perf-node-gather-daemonset-lqgzt" Jul 22 17:47:12.053357 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.053324 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-29qvb_d44e6d93-48a0-4a1e-8fa1-8268eaf2b8bd/kube-multus/0.log" Jul 22 17:47:12.106728 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.106695 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/kube-multus-additional-cni-plugins/0.log" Jul 22 17:47:12.140712 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.140681 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/egress-router-binary-copy/0.log" Jul 22 17:47:12.177775 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.177743 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/cni-plugins/0.log" Jul 22 17:47:12.215630 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.215600 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/bond-cni-plugin/0.log" Jul 22 17:47:12.255607 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.255581 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/routeoverride-cni/0.log" Jul 22 17:47:12.292806 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.292777 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/whereabouts-cni-bincopy/0.log" Jul 22 17:47:12.331828 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.331745 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gf4tx_ad7a40b5-78a3-444b-a990-59ac7847f109/whereabouts-cni/0.log" Jul 22 17:47:12.824613 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.824578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvfvp_b9de728b-83a2-464e-be35-04d26c6a8c60/network-metrics-daemon/0.log" Jul 22 17:47:12.854937 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:12.854891 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvfvp_b9de728b-83a2-464e-be35-04d26c6a8c60/kube-rbac-proxy/0.log" Jul 22 17:47:14.082796 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.082762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-controller/0.log" Jul 22 17:47:14.100179 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.100147 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/0.log" Jul 22 17:47:14.100350 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.100157 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovn-acl-logging/1.log" Jul 22 17:47:14.119367 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.119334 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/kube-rbac-proxy-node/0.log" Jul 22 17:47:14.142748 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.142707 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/kube-rbac-proxy-ovn-metrics/0.log" Jul 22 17:47:14.162758 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.162719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/northd/0.log" Jul 22 17:47:14.183917 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.183885 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/nbdb/0.log" Jul 22 17:47:14.207897 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.207869 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/sbdb/0.log" Jul 22 17:47:14.269844 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:14.269803 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vcp5l_a3003f4c-5727-487b-a5a8-960a88011272/ovnkube-controller/0.log" Jul 22 17:47:15.293405 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:15.293370 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-sr8m6_6dd9e1e9-feae-4e9c-aa4c-61d9bdb4b48e/network-check-target-container/0.log" Jul 22 17:47:16.190862 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:16.190828 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qnf82_2e899166-40ce-4fd8-9d09-3c945a004277/iptables-alerter/0.log" Jul 22 17:47:16.816977 ip-10-0-134-17 kubenswrapper[2582]: I0722 17:47:16.816946 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5zcdz_ba71b82b-a4c4-40f8-9c36-2dead93d7b0b/tuned/0.log"