Jul 02 21:16:30.062142 ip-10-0-140-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 21:16:30.062156 ip-10-0-140-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 21:16:30.062166 ip-10-0-140-1 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 21:16:30.062515 ip-10-0-140-1 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 21:16:40.072672 ip-10-0-140-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 21:16:40.072683 ip-10-0-140-1 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot afc137c4d5334cd2adb3aa59670f48fe -- Jul 02 21:18:07.078855 ip-10-0-140-1 systemd[1]: Starting Kubernetes Kubelet... Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.537360 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542130 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542142 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542146 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542150 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542155 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542157 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542161 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:07.562940 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542164 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542166 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542169 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542172 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542175 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542177 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542181 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542185 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542188 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542191 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542193 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542196 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542198 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542201 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542204 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542207 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542210 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542213 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542215 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542225 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:07.880538 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542228 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.616870 ip-10-0-140-1 systemd[1]: Started Kubernetes Kubelet. Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542231 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542233 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542236 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542239 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542244 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542246 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542249 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542251 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542254 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542257 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542260 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542262 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542265 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542267 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542270 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542273 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542276 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542278 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542281 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:07.894542 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542283 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542286 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542288 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542291 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542293 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542297 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542300 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542303 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542306 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542309 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542311 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542314 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542317 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542319 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542322 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542325 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542329 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542332 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542336 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:07.895881 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542339 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542342 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542345 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542347 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542350 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542352 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542355 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542358 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542361 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542363 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542367 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542372 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542375 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542378 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542380 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542383 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542386 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542388 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542391 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542393 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:07.896997 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542396 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542398 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542401 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542404 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542406 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542408 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542411 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542414 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542416 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542418 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542421 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542423 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.542426 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543113 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543120 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543123 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543125 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543128 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543131 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543134 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.898031 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543136 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543139 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543142 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543144 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543147 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543150 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543153 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543156 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543158 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543161 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543165 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543167 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543170 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543173 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543175 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543177 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543180 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543184 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543188 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543191 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.898885 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543194 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543196 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543199 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543204 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543208 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543212 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543215 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543218 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543220 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543223 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543226 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543229 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543232 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543236 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543238 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543241 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543243 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543246 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543248 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:07.899528 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543251 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543254 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543256 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543259 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543261 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543264 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543266 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543269 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543272 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543274 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543277 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543279 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543282 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543284 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543286 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543289 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543293 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543295 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543298 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:07.900158 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543301 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543303 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543306 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543308 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543311 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543313 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543316 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543318 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543321 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543323 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543326 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543328 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543333 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543335 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543339 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543342 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543345 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543349 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543352 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.900768 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543355 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543357 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543360 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543363 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543365 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543368 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543370 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543373 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543375 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543378 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543383 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543386 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543388 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543391 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543393 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543771 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543777 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543781 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543785 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:07.901404 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543788 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543791 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543793 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543796 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543800 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543803 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543806 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543809 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543811 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543814 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543817 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543819 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543822 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543825 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543827 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543830 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543833 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543835 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543837 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543840 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.902029 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543842 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543845 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543848 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543852 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543855 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543858 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543861 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543863 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543866 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543868 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543871 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543874 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543876 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543879 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543881 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543883 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543887 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543890 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543893 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543896 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.902894 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543898 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543901 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543903 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543906 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543908 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543911 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543913 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543915 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543918 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543921 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543923 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543925 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543928 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543930 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543933 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543936 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543939 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543941 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543945 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543947 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.903561 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543950 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543952 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543955 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543957 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543959 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543962 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543964 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543967 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543971 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543973 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543976 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543981 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543986 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543989 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543993 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543996 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.543999 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544001 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544004 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:07.904360 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544006 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544009 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544011 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544014 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544016 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544019 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544021 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544024 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544027 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544030 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544032 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544035 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544037 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544040 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544042 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544045 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544108 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544115 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544121 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544125 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544129 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 21:18:07.904992 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544135 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544139 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544143 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544147 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544150 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544154 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544157 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544160 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544163 2585 flags.go:64] FLAG: --cgroup-root="" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544166 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544169 2585 flags.go:64] FLAG: --client-ca-file="" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544172 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544175 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544184 2585 flags.go:64] FLAG: --cluster-domain="" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544187 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544190 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544193 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544196 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544199 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544203 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544206 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544210 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544213 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544216 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 21:18:07.905630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544220 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544223 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544226 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544229 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544232 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544235 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544238 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544241 2585 flags.go:64] FLAG: --enable-server="true" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544245 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544251 2585 flags.go:64] FLAG: --event-burst="100" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544254 2585 flags.go:64] FLAG: --event-qps="50" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544257 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544260 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544263 2585 flags.go:64] FLAG: --eviction-hard="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544272 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544275 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544278 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544281 2585 flags.go:64] FLAG: --eviction-soft="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544284 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544287 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544289 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544292 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544295 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544298 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544300 2585 flags.go:64] FLAG: --feature-gates="" Jul 02 21:18:07.906412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544304 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544307 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544311 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544314 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544317 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544320 2585 flags.go:64] FLAG: --help="false" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544322 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-140-1.ec2.internal" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544325 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544328 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544331 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544334 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544337 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544340 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544342 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544345 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544349 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544352 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544354 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544357 2585 flags.go:64] FLAG: --kube-reserved="" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544360 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544363 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544366 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544374 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544377 2585 flags.go:64] FLAG: --lock-file="" Jul 02 21:18:07.907267 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544379 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544382 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544385 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544390 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544392 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544395 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544398 2585 flags.go:64] FLAG: --logging-format="text" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544400 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544403 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544406 2585 flags.go:64] FLAG: --manifest-url="" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544410 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544414 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544417 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544420 2585 flags.go:64] FLAG: --max-pods="110" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544423 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544426 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544429 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544432 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544435 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544438 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544440 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544447 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544450 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544455 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 21:18:07.908102 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544458 2585 flags.go:64] FLAG: --pod-cidr="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544461 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544466 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544469 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544471 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544474 2585 flags.go:64] FLAG: --port="10250" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544477 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544486 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d17f53e18548cd1" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544489 2585 flags.go:64] FLAG: --qos-reserved="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544492 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544495 2585 flags.go:64] FLAG: --register-node="true" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544498 2585 flags.go:64] FLAG: --register-with-taints="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544501 2585 flags.go:64] FLAG: --registry-burst="10" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544504 2585 flags.go:64] FLAG: --registry-qps="5" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544506 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544509 2585 flags.go:64] FLAG: --reserved-memory="" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544513 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544516 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544519 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544523 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544526 2585 flags.go:64] FLAG: --runonce="false" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544529 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544532 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544535 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544538 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 21:18:07.908946 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544540 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544543 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544546 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544549 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544552 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544555 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544559 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544562 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544565 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544586 2585 flags.go:64] FLAG: --system-cgroups="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544591 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544598 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544601 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544619 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544624 2585 flags.go:64] FLAG: --tls-min-version="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544628 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544631 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544634 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544637 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544640 2585 flags.go:64] FLAG: --v="2" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544644 2585 flags.go:64] FLAG: --version="false" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544647 2585 flags.go:64] FLAG: --vmodule="" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544654 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.544658 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544765 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:07.911979 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544768 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544773 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544776 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544778 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544781 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544784 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544786 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544789 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544792 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544794 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544797 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544800 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544802 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544806 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544808 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544811 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544813 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544817 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544819 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.912845 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544822 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544824 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544827 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544829 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544832 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544835 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544837 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544840 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544843 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544847 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544850 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544853 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544856 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544858 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544862 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544865 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544867 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544870 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544872 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544875 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:07.992556 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544877 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544880 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544884 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544887 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544890 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544893 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544897 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544899 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544901 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544904 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544906 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544909 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544911 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544914 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544917 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544919 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544922 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544925 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544927 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:07.993190 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544930 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544932 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544935 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544937 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544940 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544943 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544945 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544949 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544951 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544954 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544958 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544961 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544964 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544967 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544970 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544973 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544976 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544978 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544981 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544985 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:07.993817 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544988 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544990 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544993 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544995 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.544998 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545000 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545003 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545005 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545008 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545010 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545013 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545016 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545018 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545021 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545023 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545025 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545028 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545030 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545033 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.994442 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.545036 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.545759 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.552413 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.552427 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.553417 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.553424 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553479 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553484 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553487 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553490 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553493 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553496 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553498 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553501 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553504 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.995014 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553507 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553509 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553512 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553515 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553518 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553521 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553523 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553526 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553528 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553531 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553533 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553536 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553538 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553542 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553545 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553547 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553550 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553552 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553556 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:07.995854 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553560 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553565 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553585 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553588 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553592 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553595 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553598 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553601 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553604 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553607 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553610 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553614 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553617 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553619 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553622 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553625 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553628 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553630 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553633 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553636 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:07.996482 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553638 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553641 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553643 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553646 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553648 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553651 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553654 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553656 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553660 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553664 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553667 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553669 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553672 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553675 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553678 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553681 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553683 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553686 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553688 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553691 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:07.997111 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553693 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553696 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553702 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553705 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553707 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553710 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553712 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553715 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553717 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553720 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553723 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553725 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553728 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553731 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553733 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553736 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553740 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553743 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553745 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.997739 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553748 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553750 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553753 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553755 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553758 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553761 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553763 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553766 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553769 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553771 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553774 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553778 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.553783 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553914 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553919 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 21:18:07.998366 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553924 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553927 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553930 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553933 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553936 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553938 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553941 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553943 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553946 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553948 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553951 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553954 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553958 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553961 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553965 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553969 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553973 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553975 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553978 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 21:18:07.998999 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553981 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553984 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553987 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553989 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553992 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553995 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.553998 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554001 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554004 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554007 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554009 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554012 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554014 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554018 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554020 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554022 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554025 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554028 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554030 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554033 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 21:18:07.999830 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554035 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554038 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554040 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554042 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554045 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554047 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554050 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554052 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554056 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554058 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554061 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554064 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554067 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554069 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554072 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554074 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554077 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554079 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554082 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554084 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 21:18:08.000476 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554087 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554091 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554094 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554097 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554100 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554104 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554107 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554110 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554113 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554116 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554119 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554122 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554126 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554128 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554131 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554133 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554136 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554139 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 21:18:08.001114 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554141 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554144 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554147 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554150 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554152 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554155 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554157 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554160 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554162 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554165 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554167 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554170 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554173 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554175 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554177 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554180 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554183 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554185 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554187 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 21:18:08.001600 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:07.554191 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.554195 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.554290 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.556674 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.558048 2585 server.go:1019] "Starting client certificate rotation" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.558149 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.558180 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.563666 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.565744 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.578772 2585 log.go:25] "Validated CRI v1 runtime API" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.581142 2585 log.go:25] "Validated CRI v1 image API" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.581907 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 21:18:08.002121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.584279 2585 fs.go:135] Filesystem UUIDs: map[5db0babc-1791-44b0-941d-969f72b4841f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 df7d1023-5a9a-4377-b447-41ca979de5dd:/dev/nvme0n1p3] Jul 02 21:18:08.002503 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.584302 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.590906 2585 manager.go:216] Machine: {Timestamp:2026-07-02 21:18:07.589212589 +0000 UTC m=+0.371583396 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3143389 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235f5dfb738cf89d090199468d596f SystemUUID:ec235f5d-fb73-8cf8-9d09-0199468d596f BootID:afc137c4-d533-4cd2-adb3-aa59670f48fe Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:d4:bb:d1:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:d4:bb:d1:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:a0:e7:32:4d:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.591009 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.591081 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.592730 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.594700 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.594734 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 21:18:08.002622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.595603 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.595612 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.595619 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.596438 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.598128 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601711 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601828 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601858 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601874 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601887 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601897 2585 kubelet.go:398] "Adding apiserver pod source" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.601905 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.602320 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.602351 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.605192 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.607619 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.607646 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.608992 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609006 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609011 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609016 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609025 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609032 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609044 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609052 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609061 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609066 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609079 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.609084 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.610215 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.610229 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.615887 2585 server.go:1268] "Started kubelet" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.615926 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.615944 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.616002 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.616050 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.616067 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.616107 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.619613 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.619647 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 02 21:18:08.002878 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.620325 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.621837 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-1.ec2.internal.18be95b0763e19bf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-1.ec2.internal,UID:ip-10-0-140-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-1.ec2.internal,},FirstTimestamp:2026-07-02 21:18:07.615859135 +0000 UTC m=+0.398229978,LastTimestamp:2026-07-02 21:18:07.615859135 +0000 UTC m=+0.398229978,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-1.ec2.internal,}" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627080 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627079 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.627180 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627929 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627932 2585 factory.go:55] Registering systemd factory Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627966 2585 factory.go:223] Registration of the systemd container factory successfully Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.627933 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628024 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628105 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628114 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628250 2585 factory.go:153] Registering CRI-O factory Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628262 2585 factory.go:223] Registration of the crio container factory successfully Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628309 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628328 2585 factory.go:103] Registering Raw factory Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628337 2585 manager.go:1196] Started watching for new ooms in manager Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.628801 2585 manager.go:349] Starting recovery of all containers Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.629586 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.629729 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.636271 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.641590 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xgnrn" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.643425 2585 manager.go:354] Recovery completed Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.647308 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xgnrn" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.650050 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.651900 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.651927 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.651937 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.652473 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.652487 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.652491 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.652506 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653226 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.003975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653253 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653263 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653836 2585 policy_none.go:49] "None policy: Start" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653848 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.653859 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.656091 2585 policy_none.go:47] "Start" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.703008 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.703044 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.703065 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.703093 2585 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.705428 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.727474 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.732700 2585 manager.go:337] "Starting Device Plugin manager" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.732724 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.732733 2585 server.go:87] "Starting device plugin registration server" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.732938 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.732946 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.733078 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.733153 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.733162 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.733620 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.733671 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.803516 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal"] Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.803613 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.805321 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.805352 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.805366 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.806705 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.806806 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.806834 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807448 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807469 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807483 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807513 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807535 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.807546 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.808708 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.005132 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.808737 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.809406 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.809428 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.809437 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.829444 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.829466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.829490 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ee7ae6cb4162cf8d32078bd8fdb4ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-1.ec2.internal\" (UID: \"8ee7ae6cb4162cf8d32078bd8fdb4ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.832993 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.833711 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientMemory" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.833734 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.833746 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeHasSufficientPID" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.833768 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.835280 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-1.ec2.internal\" not found" node="ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.835706 2585 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-1.ec2.internal\" not found" node="ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.839588 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-1.ec2.internal\" not found" node="ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.841807 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.841824 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-1.ec2.internal\": node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.864323 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930517 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930534 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ee7ae6cb4162cf8d32078bd8fdb4ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-1.ec2.internal\" (UID: \"8ee7ae6cb4162cf8d32078bd8fdb4ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.006221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930466 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.078481 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930609 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df73a401992b2b366efa0a37c15c3cbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal\" (UID: \"df73a401992b2b366efa0a37c15c3cbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.078481 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:07.930588 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ee7ae6cb4162cf8d32078bd8fdb4ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-140-1.ec2.internal\" (UID: \"8ee7ae6cb4162cf8d32078bd8fdb4ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.078481 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:07.964491 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.078481 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.065080 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.165302 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.139748 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.165302 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.144749 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.172746 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.166060 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.362436 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.266485 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.443299 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.367002 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.541030 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.467449 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.615889 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.557972 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 21:18:08.615889 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.558112 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 21:18:08.615889 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.568229 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.685815 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.649870 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:13:08 +0000 UTC" deadline="2028-01-08 03:23:32.155203853 +0000 UTC" Jul 02 21:18:08.685815 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.649903 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13302h5m23.505303651s" Jul 02 21:18:08.685815 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:08.669005 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-1.ec2.internal\" not found" Jul 02 21:18:08.759500 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.695580 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:08.765319 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.764487 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:08.833461 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.827855 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.842973 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.841796 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:08.842973 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.842794 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" Jul 02 21:18:08.930716 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.849160 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 21:18:08.930716 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:08.892831 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf73a401992b2b366efa0a37c15c3cbc.slice/crio-2786bf88ecd892b5523b8241773d904b8a916a1e65adec6f5a56a3700bbcfa84 WatchSource:0}: Error finding container 2786bf88ecd892b5523b8241773d904b8a916a1e65adec6f5a56a3700bbcfa84: Status 404 returned error can't find the container with id 2786bf88ecd892b5523b8241773d904b8a916a1e65adec6f5a56a3700bbcfa84 Jul 02 21:18:08.930716 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:08.897464 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:18:08.930716 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:08.914834 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee7ae6cb4162cf8d32078bd8fdb4ae5.slice/crio-16e5441eef145a2fd8d53c61f96bec735166126722997591a386c30f41b46685 WatchSource:0}: Error finding container 16e5441eef145a2fd8d53c61f96bec735166126722997591a386c30f41b46685: Status 404 returned error can't find the container with id 16e5441eef145a2fd8d53c61f96bec735166126722997591a386c30f41b46685 Jul 02 21:18:09.210045 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.137748 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:09.603441 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.603307 2585 apiserver.go:52] "Watching apiserver" Jul 02 21:18:09.615430 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.615402 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 21:18:09.617105 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.617065 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4bl5k","kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal","openshift-image-registry/node-ca-lq79g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal","openshift-multus/multus-additional-cni-plugins-z5hhs","openshift-network-operator/iptables-alerter-hx58k","openshift-ovn-kubernetes/ovnkube-node-jhw2p","kube-system/konnectivity-agent-hprp4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg","openshift-cluster-node-tuning-operator/tuned-gh97c","openshift-dns/node-resolver-nh5kn","openshift-multus/multus-ncsks","openshift-multus/network-metrics-daemon-z6f2h","openshift-network-diagnostics/network-check-target-fjbmt"] Jul 02 21:18:09.618759 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.618733 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.620409 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.620062 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.621343 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.621317 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.621449 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.621350 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.621885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.621863 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.621885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.621881 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp9w7\"" Jul 02 21:18:09.622325 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.622303 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.623313 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.622699 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4rhwg\"" Jul 02 21:18:09.623313 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.623271 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.623562 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.623545 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 21:18:09.623897 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.623879 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.624126 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.624104 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.624279 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.624261 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wrcpd\"" Jul 02 21:18:09.624341 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.624328 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:09.624418 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.624391 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:09.624587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.624572 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.625792 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.625562 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 21:18:09.625909 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.625856 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.625976 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.625914 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:09.626939 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.626757 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.627292 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.627269 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.627485 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.627466 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 21:18:09.628721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.627613 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 21:18:09.628721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.628339 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 21:18:09.628721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.628509 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 21:18:09.628721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.628704 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 21:18:09.628975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.628944 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.629136 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629111 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.629590 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629439 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b4ctk\"" Jul 02 21:18:09.629590 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629586 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.629799 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629684 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rv7kb\"" Jul 02 21:18:09.629799 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629720 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 21:18:09.630109 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629956 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 21:18:09.630109 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.629979 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.630268 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.630124 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 21:18:09.630407 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.630384 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.630508 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.630446 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:09.631259 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.631174 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.631783 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.631761 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 21:18:09.632005 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.631980 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.632608 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.632343 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.632608 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.632421 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kj6rg\"" Jul 02 21:18:09.633417 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.633395 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.634715 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.634467 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 21:18:09.635529 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.634849 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 21:18:09.635529 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.635103 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hq5bs\"" Jul 02 21:18:09.635529 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.635122 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.636287 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.636035 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 21:18:09.636287 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.636063 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cd42p\"" Jul 02 21:18:09.638226 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.637608 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 21:18:09.638226 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.637961 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 21:18:09.638226 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.638102 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wk2k\"" Jul 02 21:18:09.642432 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.642409 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 21:18:09.665614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.665418 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzkbx" Jul 02 21:18:09.668188 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668168 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-systemd-units\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668295 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668197 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-systemd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668295 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668214 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-node-log\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668295 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668237 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws5sx\" (UniqueName: \"kubernetes.io/projected/a6517864-7395-4408-8cb1-d6387db8bbc3-kube-api-access-ws5sx\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668295 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668262 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72bc5134-5e61-4304-a9b4-044233245391-host\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.668295 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668284 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-bin\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-kubernetes\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-tuned\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-lib-modules\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668415 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-registration-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668441 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-config\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.668555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668516 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668578 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-var-lib-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668629 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668659 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-modprobe-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668686 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-ovn\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668704 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668721 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-env-overrides\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668743 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-cnibin\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668865 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-sys-fs\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-log-socket\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.668914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668909 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72bc5134-5e61-4304-a9b4-044233245391-serviceca\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668928 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wgt\" (UniqueName: \"kubernetes.io/projected/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-kube-api-access-k5wgt\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668951 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-conf\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.668994 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669040 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-slash\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669069 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6517864-7395-4408-8cb1-d6387db8bbc3-ovn-node-metrics-cert\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-script-lib\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-os-release\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669166 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jlc\" (UniqueName: \"kubernetes.io/projected/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kube-api-access-f7jlc\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-system-cni-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669250 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvglt\" (UniqueName: \"kubernetes.io/projected/20a8b808-85ea-4dd0-916e-04fde4d5f61e-kube-api-access-wvglt\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-socket-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.669416 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-kubelet\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669327 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-netns\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669342 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-etc-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669426 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669458 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfgb5\" (UniqueName: \"kubernetes.io/projected/eeebab5a-bc8c-49c2-9bbe-95337a177513-kube-api-access-cfgb5\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669492 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669507 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-netd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669527 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-systemd\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-sys\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669572 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-var-lib-kubelet\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669614 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669647 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw2gr\" (UniqueName: \"kubernetes.io/projected/72bc5134-5e61-4304-a9b4-044233245391-kube-api-access-xw2gr\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669662 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-iptables-alerter-script\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.669990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669685 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-device-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669710 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2qht\" (UniqueName: \"kubernetes.io/projected/f491b574-ab3f-467d-9344-ea16d3eb7abb-kube-api-access-v2qht\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-host-slash\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669747 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysconfig\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669764 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-run\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669854 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-host\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.670587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.669915 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-tmp\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.671290 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.671265 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzkbx" Jul 02 21:18:09.709418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.709370 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" event={"ID":"df73a401992b2b366efa0a37c15c3cbc","Type":"ContainerStarted","Data":"2786bf88ecd892b5523b8241773d904b8a916a1e65adec6f5a56a3700bbcfa84"} Jul 02 21:18:09.710694 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.710668 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" event={"ID":"8ee7ae6cb4162cf8d32078bd8fdb4ae5","Type":"ContainerStarted","Data":"16e5441eef145a2fd8d53c61f96bec735166126722997591a386c30f41b46685"} Jul 02 21:18:09.729528 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.729506 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 21:18:09.770369 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6517864-7395-4408-8cb1-d6387db8bbc3-ovn-node-metrics-cert\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770382 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-script-lib\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770410 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-os-release\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770436 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770466 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jlc\" (UniqueName: \"kubernetes.io/projected/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kube-api-access-f7jlc\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770493 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-system-cni-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770525 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770550 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-multus-certs\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.770621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvglt\" (UniqueName: \"kubernetes.io/projected/20a8b808-85ea-4dd0-916e-04fde4d5f61e-kube-api-access-wvglt\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770627 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-socket-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-kubelet\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770670 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-netns\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770700 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-etc-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cni-binary-copy\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770732 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-hostroot\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770750 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770766 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfgb5\" (UniqueName: \"kubernetes.io/projected/eeebab5a-bc8c-49c2-9bbe-95337a177513-kube-api-access-cfgb5\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770796 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770825 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-netd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770846 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-bin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770854 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-os-release\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770864 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-kubelet\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-systemd\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770882 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.770937 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-etc-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.771031 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771040 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-script-lib\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.771092 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:10.271071203 +0000 UTC m=+3.053441999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771109 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-system-cni-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771168 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-kubelet\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771232 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-systemd\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771280 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-sys\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771289 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-netd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771333 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-var-lib-kubelet\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771365 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-sys\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771385 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771394 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-socket-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.771832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771419 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-run-netns\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771417 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771445 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-var-lib-kubelet\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771488 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771529 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-conf-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04e1781a-08a8-4f8b-b463-ea461015b06e-konnectivity-ca\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771587 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw2gr\" (UniqueName: \"kubernetes.io/projected/72bc5134-5e61-4304-a9b4-044233245391-kube-api-access-xw2gr\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771623 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-iptables-alerter-script\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771667 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-device-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2qht\" (UniqueName: \"kubernetes.io/projected/f491b574-ab3f-467d-9344-ea16d3eb7abb-kube-api-access-v2qht\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-host-slash\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771761 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysconfig\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-run\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771868 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-run\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.772425 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771898 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-host-slash\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771928 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysconfig\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771956 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-device-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.771990 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-host\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772041 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-tmp\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-systemd-units\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-systemd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772106 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-node-log\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-os-release\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772166 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-k8s-cni-cncf-io\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772189 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws5sx\" (UniqueName: \"kubernetes.io/projected/a6517864-7395-4408-8cb1-d6387db8bbc3-kube-api-access-ws5sx\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c93a01a-5785-4859-b6d4-90c8c5f07a69-tmp-dir\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-netns\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772292 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72bc5134-5e61-4304-a9b4-044233245391-host\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.773072 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-bin\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772341 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-iptables-alerter-script\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772357 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-kubernetes\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772419 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-host\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772504 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772701 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72bc5134-5e61-4304-a9b4-044233245391-host\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772745 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-system-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772758 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-cni-bin\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772777 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cnibin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772808 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-kubernetes\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-tuned\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c93a01a-5785-4859-b6d4-90c8c5f07a69-hosts-file\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-multus\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772891 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-systemd-units\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772913 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04e1781a-08a8-4f8b-b463-ea461015b06e-agent-certs\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.773638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-lib-modules\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-registration-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772996 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773021 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-config\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773047 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773073 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773100 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5v7w\" (UniqueName: \"kubernetes.io/projected/1c93a01a-5785-4859-b6d4-90c8c5f07a69-kube-api-access-x5v7w\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-daemon-config\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773167 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-var-lib-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773193 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773219 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773246 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-etc-kubernetes\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773274 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8bk\" (UniqueName: \"kubernetes.io/projected/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-kube-api-access-jw8bk\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773300 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-modprobe-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.774211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773340 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-ovn\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773367 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773392 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-env-overrides\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773418 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-cnibin\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773475 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-kubelet-config\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773501 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-socket-dir-parent\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773529 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-sys-fs\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773560 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-log-socket\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773612 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-dbus\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72bc5134-5e61-4304-a9b4-044233245391-serviceca\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773680 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wgt\" (UniqueName: \"kubernetes.io/projected/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-kube-api-access-k5wgt\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-conf\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773725 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.774809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773751 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-slash\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773838 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-slash\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.772860 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-systemd\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773934 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-registration-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773987 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-lib-modules\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.773989 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774075 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-run-ovn\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774099 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-modprobe-d\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774124 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-node-log\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774150 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774170 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-cnibin\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774448 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-env-overrides\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774502 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-var-lib-openvswitch\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774716 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6517864-7395-4408-8cb1-d6387db8bbc3-ovnkube-config\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.775583 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774779 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-binary-copy\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774893 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-sys-fs\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774933 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6517864-7395-4408-8cb1-d6387db8bbc3-log-socket\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.774976 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775012 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775073 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-sysctl-conf\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775295 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f491b574-ab3f-467d-9344-ea16d3eb7abb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775386 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-etc-tuned\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775520 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/72bc5134-5e61-4304-a9b4-044233245391-serviceca\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775533 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f491b574-ab3f-467d-9344-ea16d3eb7abb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.776289 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.775932 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6517864-7395-4408-8cb1-d6387db8bbc3-ovn-node-metrics-cert\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.776677 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.776566 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20a8b808-85ea-4dd0-916e-04fde4d5f61e-tmp\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.792182 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.792158 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:09.792182 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.792184 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:09.792361 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.792197 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:09.792361 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.792264 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:10.292246277 +0000 UTC m=+3.074617094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:09.794200 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.794146 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvglt\" (UniqueName: \"kubernetes.io/projected/20a8b808-85ea-4dd0-916e-04fde4d5f61e-kube-api-access-wvglt\") pod \"tuned-gh97c\" (UID: \"20a8b808-85ea-4dd0-916e-04fde4d5f61e\") " pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.794200 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.794159 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw2gr\" (UniqueName: \"kubernetes.io/projected/72bc5134-5e61-4304-a9b4-044233245391-kube-api-access-xw2gr\") pod \"node-ca-lq79g\" (UID: \"72bc5134-5e61-4304-a9b4-044233245391\") " pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.796210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.796188 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws5sx\" (UniqueName: \"kubernetes.io/projected/a6517864-7395-4408-8cb1-d6387db8bbc3-kube-api-access-ws5sx\") pod \"ovnkube-node-jhw2p\" (UID: \"a6517864-7395-4408-8cb1-d6387db8bbc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.797080 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.796892 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfgb5\" (UniqueName: \"kubernetes.io/projected/eeebab5a-bc8c-49c2-9bbe-95337a177513-kube-api-access-cfgb5\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:09.797324 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.797285 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2qht\" (UniqueName: \"kubernetes.io/projected/f491b574-ab3f-467d-9344-ea16d3eb7abb-kube-api-access-v2qht\") pod \"multus-additional-cni-plugins-z5hhs\" (UID: \"f491b574-ab3f-467d-9344-ea16d3eb7abb\") " pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.798618 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.798148 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wgt\" (UniqueName: \"kubernetes.io/projected/4fcae706-c6b0-4bdf-9dc2-286c3bab7dba-kube-api-access-k5wgt\") pod \"iptables-alerter-hx58k\" (UID: \"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba\") " pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.798618 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.798582 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jlc\" (UniqueName: \"kubernetes.io/projected/02363fe0-b7b8-4be1-be4b-d6e65780a0b0-kube-api-access-f7jlc\") pod \"aws-ebs-csi-driver-node-pqpwg\" (UID: \"02363fe0-b7b8-4be1-be4b-d6e65780a0b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.874172 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874088 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.874172 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-multus-certs\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874172 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874163 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-multus-certs\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874209 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cni-binary-copy\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874247 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-hostroot\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874288 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-bin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874312 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-kubelet\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.874315 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-conf-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874360 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04e1781a-08a8-4f8b-b463-ea461015b06e-konnectivity-ca\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:09.874376 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:10.374357858 +0000 UTC m=+3.156728667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874399 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-bin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874422 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-os-release\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.874495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-k8s-cni-cncf-io\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874506 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-k8s-cni-cncf-io\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874541 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-hostroot\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874577 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-kubelet\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874630 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-conf-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c93a01a-5785-4859-b6d4-90c8c5f07a69-tmp-dir\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874671 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-os-release\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-netns\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874819 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-system-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874853 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cnibin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874873 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-system-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c93a01a-5785-4859-b6d4-90c8c5f07a69-hosts-file\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874820 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-run-netns\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874875 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cni-binary-copy\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874911 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-multus\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874938 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04e1781a-08a8-4f8b-b463-ea461015b06e-agent-certs\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.875057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874943 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-cnibin\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874954 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c93a01a-5785-4859-b6d4-90c8c5f07a69-hosts-file\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874968 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04e1781a-08a8-4f8b-b463-ea461015b06e-konnectivity-ca\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874985 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-host-var-lib-cni-multus\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874987 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c93a01a-5785-4859-b6d4-90c8c5f07a69-tmp-dir\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.874965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5v7w\" (UniqueName: \"kubernetes.io/projected/1c93a01a-5785-4859-b6d4-90c8c5f07a69-kube-api-access-x5v7w\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-daemon-config\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875065 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875090 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-etc-kubernetes\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875115 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8bk\" (UniqueName: \"kubernetes.io/projected/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-kube-api-access-jw8bk\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875162 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-kubelet-config\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875168 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-etc-kubernetes\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875203 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-socket-dir-parent\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875232 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-dbus\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875326 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-kubelet-config\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.875788 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875342 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-cni-dir\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.876327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875368 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/856de997-a6a6-44c1-9adc-48e93581b453-dbus\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:09.876327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875404 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-socket-dir-parent\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.876327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.875521 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-multus-daemon-config\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.878399 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.878378 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04e1781a-08a8-4f8b-b463-ea461015b06e-agent-certs\") pod \"konnectivity-agent-hprp4\" (UID: \"04e1781a-08a8-4f8b-b463-ea461015b06e\") " pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:09.886528 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.886502 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5v7w\" (UniqueName: \"kubernetes.io/projected/1c93a01a-5785-4859-b6d4-90c8c5f07a69-kube-api-access-x5v7w\") pod \"node-resolver-nh5kn\" (UID: \"1c93a01a-5785-4859-b6d4-90c8c5f07a69\") " pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.886829 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.886804 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8bk\" (UniqueName: \"kubernetes.io/projected/3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8-kube-api-access-jw8bk\") pod \"multus-ncsks\" (UID: \"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8\") " pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.934642 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.934612 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gh97c" Jul 02 21:18:09.942689 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.942654 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" Jul 02 21:18:09.944857 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.944820 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a8b808_85ea_4dd0_916e_04fde4d5f61e.slice/crio-eda2270c4b571a993be741ab339c793b97ef8d41379b34364241032ab6142ac9 WatchSource:0}: Error finding container eda2270c4b571a993be741ab339c793b97ef8d41379b34364241032ab6142ac9: Status 404 returned error can't find the container with id eda2270c4b571a993be741ab339c793b97ef8d41379b34364241032ab6142ac9 Jul 02 21:18:09.951834 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.951809 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02363fe0_b7b8_4be1_be4b_d6e65780a0b0.slice/crio-406841cc893f9ba7cacf404349708441f274385dcff933366a80ad9ab4e37cb3 WatchSource:0}: Error finding container 406841cc893f9ba7cacf404349708441f274385dcff933366a80ad9ab4e37cb3: Status 404 returned error can't find the container with id 406841cc893f9ba7cacf404349708441f274385dcff933366a80ad9ab4e37cb3 Jul 02 21:18:09.953127 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.953100 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lq79g" Jul 02 21:18:09.958817 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.958794 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:09.962678 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.962560 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bc5134_5e61_4304_a9b4_044233245391.slice/crio-6a83d534f1d1d781885471ee1ec3d6137a9920c5c7da6d0790e0ea6f8a6c0fdb WatchSource:0}: Error finding container 6a83d534f1d1d781885471ee1ec3d6137a9920c5c7da6d0790e0ea6f8a6c0fdb: Status 404 returned error can't find the container with id 6a83d534f1d1d781885471ee1ec3d6137a9920c5c7da6d0790e0ea6f8a6c0fdb Jul 02 21:18:09.968261 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.968039 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" Jul 02 21:18:09.968350 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.968295 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6517864_7395_4408_8cb1_d6387db8bbc3.slice/crio-f71883da40f6012334a57cbd55d7a236b4e26e69718474827009c6650aab4e41 WatchSource:0}: Error finding container f71883da40f6012334a57cbd55d7a236b4e26e69718474827009c6650aab4e41: Status 404 returned error can't find the container with id f71883da40f6012334a57cbd55d7a236b4e26e69718474827009c6650aab4e41 Jul 02 21:18:09.976018 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.975909 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx58k" Jul 02 21:18:09.978302 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.978124 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 21:18:09.978595 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.978571 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf491b574_ab3f_467d_9344_ea16d3eb7abb.slice/crio-a64ae6fd7d6ff01b475f217a9a6921b38e64a48166e48a8013eed857bf81865a WatchSource:0}: Error finding container a64ae6fd7d6ff01b475f217a9a6921b38e64a48166e48a8013eed857bf81865a: Status 404 returned error can't find the container with id a64ae6fd7d6ff01b475f217a9a6921b38e64a48166e48a8013eed857bf81865a Jul 02 21:18:09.984365 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.984299 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nh5kn" Jul 02 21:18:09.984823 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.984800 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcae706_c6b0_4bdf_9dc2_286c3bab7dba.slice/crio-3704fbf15415be666b103511932b4990ec84570e29d5594b9a0d586e25149427 WatchSource:0}: Error finding container 3704fbf15415be666b103511932b4990ec84570e29d5594b9a0d586e25149427: Status 404 returned error can't find the container with id 3704fbf15415be666b103511932b4990ec84570e29d5594b9a0d586e25149427 Jul 02 21:18:09.991887 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.991858 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncsks" Jul 02 21:18:09.994907 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:09.994881 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c93a01a_5785_4859_b6d4_90c8c5f07a69.slice/crio-e951fb76404356fb2469f391fd19daeb841bec637ac377abbb333221dd0bc5da WatchSource:0}: Error finding container e951fb76404356fb2469f391fd19daeb841bec637ac377abbb333221dd0bc5da: Status 404 returned error can't find the container with id e951fb76404356fb2469f391fd19daeb841bec637ac377abbb333221dd0bc5da Jul 02 21:18:09.999714 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:09.999533 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:10.002313 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:10.002284 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a19cac1_c7d7_4ba1_8137_cdd4f70dfdd8.slice/crio-8f1c375caf926eb5bc537058cd32c52b40883e43f7b30d76dc61bbcc96ef7c7e WatchSource:0}: Error finding container 8f1c375caf926eb5bc537058cd32c52b40883e43f7b30d76dc61bbcc96ef7c7e: Status 404 returned error can't find the container with id 8f1c375caf926eb5bc537058cd32c52b40883e43f7b30d76dc61bbcc96ef7c7e Jul 02 21:18:10.009809 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:10.009778 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e1781a_08a8_4f8b_b463_ea461015b06e.slice/crio-0080038e7e177df10a662044c57b24ad162f705778b3a1d567495e7d1a1314d9 WatchSource:0}: Error finding container 0080038e7e177df10a662044c57b24ad162f705778b3a1d567495e7d1a1314d9: Status 404 returned error can't find the container with id 0080038e7e177df10a662044c57b24ad162f705778b3a1d567495e7d1a1314d9 Jul 02 21:18:10.278801 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.278696 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:10.278987 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.278883 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:10.278987 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.278968 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:11.278947272 +0000 UTC m=+4.061318081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:10.379772 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.379729 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:10.379971 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.379782 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:10.379971 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.379907 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:10.379971 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.379938 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:10.379971 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.379963 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:10.380162 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.379979 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:10.380162 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.379982 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:11.379961936 +0000 UTC m=+4.162332730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:10.380162 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.380035 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:11.380016214 +0000 UTC m=+4.162387032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:10.673829 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.673720 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:10 +0000 UTC" deadline="2027-11-29 00:05:21.877887062 +0000 UTC" Jul 02 21:18:10.673829 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.673782 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12338h47m11.204110387s" Jul 02 21:18:10.703341 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.703312 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:10.703477 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:10.703445 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:10.715569 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.715536 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hprp4" event={"ID":"04e1781a-08a8-4f8b-b463-ea461015b06e","Type":"ContainerStarted","Data":"0080038e7e177df10a662044c57b24ad162f705778b3a1d567495e7d1a1314d9"} Jul 02 21:18:10.717368 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.717343 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nh5kn" event={"ID":"1c93a01a-5785-4859-b6d4-90c8c5f07a69","Type":"ContainerStarted","Data":"e951fb76404356fb2469f391fd19daeb841bec637ac377abbb333221dd0bc5da"} Jul 02 21:18:10.718859 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.718808 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx58k" event={"ID":"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba","Type":"ContainerStarted","Data":"3704fbf15415be666b103511932b4990ec84570e29d5594b9a0d586e25149427"} Jul 02 21:18:10.720629 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.720532 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"f71883da40f6012334a57cbd55d7a236b4e26e69718474827009c6650aab4e41"} Jul 02 21:18:10.723976 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.723950 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gh97c" event={"ID":"20a8b808-85ea-4dd0-916e-04fde4d5f61e","Type":"ContainerStarted","Data":"eda2270c4b571a993be741ab339c793b97ef8d41379b34364241032ab6142ac9"} Jul 02 21:18:10.725592 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.725558 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncsks" event={"ID":"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8","Type":"ContainerStarted","Data":"8f1c375caf926eb5bc537058cd32c52b40883e43f7b30d76dc61bbcc96ef7c7e"} Jul 02 21:18:10.727638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.727141 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerStarted","Data":"a64ae6fd7d6ff01b475f217a9a6921b38e64a48166e48a8013eed857bf81865a"} Jul 02 21:18:10.728954 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.728908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lq79g" event={"ID":"72bc5134-5e61-4304-a9b4-044233245391","Type":"ContainerStarted","Data":"6a83d534f1d1d781885471ee1ec3d6137a9920c5c7da6d0790e0ea6f8a6c0fdb"} Jul 02 21:18:10.730243 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:10.730216 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" event={"ID":"02363fe0-b7b8-4be1-be4b-d6e65780a0b0","Type":"ContainerStarted","Data":"406841cc893f9ba7cacf404349708441f274385dcff933366a80ad9ab4e37cb3"} Jul 02 21:18:11.289498 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.289440 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:11.289717 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.289673 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:11.289795 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.289766 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:13.289745535 +0000 UTC m=+6.072116334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:11.390624 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.390565 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:11.390811 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.390642 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:11.390877 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.390839 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:11.390935 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.390903 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:13.390884334 +0000 UTC m=+6.173255142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:11.391276 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.391152 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:11.391276 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.391179 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:11.391276 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.391193 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:11.391276 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.391254 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:13.391236545 +0000 UTC m=+6.173607351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:11.674923 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.674831 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:13:10 +0000 UTC" deadline="2028-01-27 08:21:58.802340209 +0000 UTC" Jul 02 21:18:11.674923 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.674872 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13763h3m47.127473597s" Jul 02 21:18:11.708390 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.708360 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:11.708563 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.708515 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:11.710195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:11.710170 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:11.710318 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:11.710293 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:12.704087 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:12.703705 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:12.704689 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:12.704207 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:12.751882 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:12.751321 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" event={"ID":"8ee7ae6cb4162cf8d32078bd8fdb4ae5","Type":"ContainerStarted","Data":"c3bddcbb7b7583b504a7e95da57ffc2861b2277feee9842eee217835f465acb4"} Jul 02 21:18:12.768163 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:12.767818 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-1.ec2.internal" podStartSLOduration=3.767795529 podStartE2EDuration="3.767795529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:12.766785268 +0000 UTC m=+5.549156085" watchObservedRunningTime="2026-07-02 21:18:12.767795529 +0000 UTC m=+5.550166348" Jul 02 21:18:13.308253 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.308210 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:13.308437 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.308374 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:13.308515 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.308441 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:17.308421825 +0000 UTC m=+10.090792622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:13.408948 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.408907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:13.409128 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.408965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:13.409128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409082 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:13.409128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409109 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:13.409128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409123 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:13.409351 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409185 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:17.409165373 +0000 UTC m=+10.191536184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:13.409533 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409087 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:13.409620 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.409571 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:17.409554264 +0000 UTC m=+10.191925084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:13.706670 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.706586 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:13.707125 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.706739 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:13.707203 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.707161 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:13.707354 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:13.707327 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:13.757115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.757075 2585 generic.go:356] "Generic (PLEG): container finished" podID="df73a401992b2b366efa0a37c15c3cbc" containerID="c258a7b20858b22549b9207ad6837d60ccaca1b3d0c819132cd75e4ddedca106" exitCode=0 Jul 02 21:18:13.757428 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:13.757400 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" event={"ID":"df73a401992b2b366efa0a37c15c3cbc","Type":"ContainerDied","Data":"c258a7b20858b22549b9207ad6837d60ccaca1b3d0c819132cd75e4ddedca106"} Jul 02 21:18:14.704080 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:14.704045 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:14.704281 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:14.704177 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:15.706003 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:15.704795 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:15.706003 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:15.704950 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:15.706003 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:15.705434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:15.706003 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:15.705543 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:16.704017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:16.703934 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:16.704182 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:16.704127 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:17.344971 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:17.344927 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:17.345553 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.345097 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:17.345553 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.345152 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.345138672 +0000 UTC m=+18.127509465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:17.445798 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:17.445734 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:17.445978 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:17.445917 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:17.445978 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.445941 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:17.445978 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.445971 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:17.446154 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.445988 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:17.446154 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.446053 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.446031653 +0000 UTC m=+18.228402471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:17.446154 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.446111 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:17.446320 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.446168 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:25.446150347 +0000 UTC m=+18.228521146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:17.705271 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:17.705159 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:17.705271 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:17.705258 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:17.705494 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.705280 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:17.705494 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:17.705405 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:18.704349 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:18.704307 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:18.704867 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:18.704448 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:19.704040 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:19.703479 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:19.704040 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:19.703512 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:19.704040 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:19.703656 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:19.704040 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:19.703762 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:20.703901 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:20.703866 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:20.704387 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:20.704000 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:21.704320 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.704237 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:21.704851 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:21.704469 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:21.704851 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.704675 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:21.704851 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:21.704812 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:21.772235 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.772208 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gh97c" event={"ID":"20a8b808-85ea-4dd0-916e-04fde4d5f61e","Type":"ContainerStarted","Data":"25b6303e4b67a819e376c8de706703d3566fa3bdb7cb38c01aa7d42a143c13ea"} Jul 02 21:18:21.773624 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.773601 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="a6f252573ef147b536dd2c70dcfea7d5eb93d8e77a5dcac886748e7b3e63b943" exitCode=0 Jul 02 21:18:21.773737 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.773677 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"a6f252573ef147b536dd2c70dcfea7d5eb93d8e77a5dcac886748e7b3e63b943"} Jul 02 21:18:21.775085 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.775063 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lq79g" event={"ID":"72bc5134-5e61-4304-a9b4-044233245391","Type":"ContainerStarted","Data":"a29f42ba593ea107a87b0da7c92aa8755fd78a3f685048ee7c04aa80e3df6427"} Jul 02 21:18:21.776535 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.776514 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" event={"ID":"02363fe0-b7b8-4be1-be4b-d6e65780a0b0","Type":"ContainerStarted","Data":"508d5a384c4102413f6a00527ec8ae8746968dc10a36c80987f2f0e151510b19"} Jul 02 21:18:21.778314 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.778292 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" event={"ID":"df73a401992b2b366efa0a37c15c3cbc","Type":"ContainerStarted","Data":"602dfdbe7fa82d2cdefb09703c9b60820a57e629253d3aea88b0542089c94955"} Jul 02 21:18:21.779619 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.779590 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hprp4" event={"ID":"04e1781a-08a8-4f8b-b463-ea461015b06e","Type":"ContainerStarted","Data":"4023dc483936ca608dced38b30928e79ec262f383a4298706162a2db11c380b7"} Jul 02 21:18:21.780964 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.780945 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nh5kn" event={"ID":"1c93a01a-5785-4859-b6d4-90c8c5f07a69","Type":"ContainerStarted","Data":"29f3e635b938e1478e8cf9dcd958e6d2ee3e992db2fd4337e4a48b0a85b49d79"} Jul 02 21:18:21.809047 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.809013 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gh97c" podStartSLOduration=2.56996336 podStartE2EDuration="13.809001824s" totalImagesPullingTime="11.239038464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:21.791895829 +0000 UTC m=+14.574266642" watchObservedRunningTime="2026-07-02 21:18:21.809001824 +0000 UTC m=+14.591372637" Jul 02 21:18:21.809133 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.809096 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nh5kn" podStartSLOduration=1.611755857 podStartE2EDuration="12.809091324s" totalImagesPullingTime="11.197335467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:21.808763105 +0000 UTC m=+14.591133917" watchObservedRunningTime="2026-07-02 21:18:21.809091324 +0000 UTC m=+14.591462137" Jul 02 21:18:21.876930 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.876878 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-1.ec2.internal" podStartSLOduration=12.876859184 podStartE2EDuration="12.876859184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:21.876433448 +0000 UTC m=+14.658804262" watchObservedRunningTime="2026-07-02 21:18:21.876859184 +0000 UTC m=+14.659229999" Jul 02 21:18:21.877415 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.877306 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hprp4" podStartSLOduration=1.703815801 podStartE2EDuration="12.877295503s" totalImagesPullingTime="11.173479702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:21.839949612 +0000 UTC m=+14.622320421" watchObservedRunningTime="2026-07-02 21:18:21.877295503 +0000 UTC m=+14.659666319" Jul 02 21:18:21.900241 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:21.900080 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lq79g" podStartSLOduration=2.463380226 podStartE2EDuration="13.900062105s" totalImagesPullingTime="11.436681879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:21.899510331 +0000 UTC m=+14.681881145" watchObservedRunningTime="2026-07-02 21:18:21.900062105 +0000 UTC m=+14.682432921" Jul 02 21:18:22.338008 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.337805 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:22.338360 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.338335 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:22.703975 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.703946 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:22.704136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:22.704052 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:22.785150 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.785119 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx58k" event={"ID":"4fcae706-c6b0-4bdf-9dc2-286c3bab7dba","Type":"ContainerStarted","Data":"ecfcf2876e7f00cd376269190e41fc7601567dba04ce600c1e87a9cb08357f72"} Jul 02 21:18:22.809405 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.809354 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hx58k" podStartSLOduration=2.611788756 podStartE2EDuration="13.809333589s" totalImagesPullingTime="11.197544833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:22.808487983 +0000 UTC m=+15.590858799" watchObservedRunningTime="2026-07-02 21:18:22.809333589 +0000 UTC m=+15.591704406" Jul 02 21:18:22.935604 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:22.935560 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 21:18:23.703874 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.703846 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:23.704053 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:23.703970 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:23.704314 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.703847 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:23.704453 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:23.704386 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:23.745550 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.744757 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:18:22.935600753Z","UUID":"0ea0f64b-2ddf-4237-8ee9-d29f4a7b2a1a","Handler":null,"Name":"","Endpoint":""} Jul 02 21:18:23.746662 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.746611 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 21:18:23.746776 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.746693 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 21:18:23.790558 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.790495 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" event={"ID":"02363fe0-b7b8-4be1-be4b-d6e65780a0b0","Type":"ContainerStarted","Data":"269c53a9bed07e54237a7ed288005812cc6ece1cb082f0f09f456f8efa3a2f54"} Jul 02 21:18:23.790558 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:23.790618 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 21:18:24.704063 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:24.704036 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:24.704286 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:24.704157 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:25.409683 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:25.409625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:25.410154 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.409838 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:25.410154 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.409905 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:41.409884296 +0000 UTC m=+34.192255100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:25.510449 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:25.510411 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:25.510615 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:25.510464 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:25.510615 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510592 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:25.510615 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510611 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:25.510615 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510615 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:25.510808 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510629 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:25.510808 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510675 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:41.510656824 +0000 UTC m=+34.293027617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:25.510808 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.510696 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:41.510686331 +0000 UTC m=+34.293057127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:25.704144 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:25.704061 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:25.704301 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:25.704061 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:25.704301 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.704203 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:25.704301 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:25.704287 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:26.703706 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:26.703671 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:26.704223 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:26.703774 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:27.707462 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:27.707427 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:27.707893 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:27.707557 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:27.707893 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:27.707628 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:27.707893 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:27.707746 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:28.704144 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:28.703965 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:28.704321 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:28.704271 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:29.706900 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:29.706867 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:29.707430 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:29.706988 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:29.707430 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:29.707047 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:29.707430 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:29.707160 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:30.493510 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:30.493478 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:30.493691 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:30.493635 2585 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 21:18:30.494400 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:30.494339 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hprp4" Jul 02 21:18:30.703621 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:30.703589 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:30.703794 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:30.703704 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:31.704035 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:31.704004 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:31.704035 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:31.704049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:31.704630 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:31.704159 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:31.704630 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:31.704302 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:32.704098 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:32.704065 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:32.704557 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:32.704193 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:33.704299 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:33.704267 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:33.704631 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:33.704364 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:33.704631 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:33.704465 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:33.704631 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:33.704600 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:34.704344 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.704187 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:34.704825 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:34.704409 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:34.817824 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"85d061bfe5264f6a522558c8e2e722091469f797d38d4695b52d66629449d5c7"} Jul 02 21:18:34.817991 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817854 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"de096b4186f298dcbbb2c9ea75101cd240a0cf0235f1e2b34f7a60715319cdb7"} Jul 02 21:18:34.817991 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817885 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"525ec6d17963bb78ea0f511e4e6fa4160295b637a87d45ce666cc1d47a2e097b"} Jul 02 21:18:34.817991 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817920 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"825618561e110006bf7e7db2af75c7702fe9f9f3e81f25f2a3a8d0264cb5f3c3"} Jul 02 21:18:34.817991 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817949 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"953a22d482cc7a7b736a41ec71ac95b3c25288ee34e3d4e89795039c642065be"} Jul 02 21:18:34.817991 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.817989 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"cd4f7c5e04aa299312d183e26f1862d52ae0f3a708e393099d4c75152d24fbe9"} Jul 02 21:18:34.819188 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.819164 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncsks" event={"ID":"3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8","Type":"ContainerStarted","Data":"310664d5e9b52ecb68669d5f919b51a9e56c2b07827e1c9f826bfd7cbb9c6a79"} Jul 02 21:18:34.820968 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.820937 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="7acae93f3cb62741cbdd0e71e87cf2f6113c9928c66cfb25fd1667542acf0ed6" exitCode=0 Jul 02 21:18:34.821062 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.821028 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"7acae93f3cb62741cbdd0e71e87cf2f6113c9928c66cfb25fd1667542acf0ed6"} Jul 02 21:18:34.824605 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.824584 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" event={"ID":"02363fe0-b7b8-4be1-be4b-d6e65780a0b0","Type":"ContainerStarted","Data":"f90c750edaa4ec3b0c609bf41843ff8f4bad870c5f87b0314a321f26652b6884"} Jul 02 21:18:34.836212 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.836174 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ncsks" podStartSLOduration=1.945559302 podStartE2EDuration="25.836162326s" totalImagesPullingTime="23.890603024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:34.835787256 +0000 UTC m=+27.618158069" watchObservedRunningTime="2026-07-02 21:18:34.836162326 +0000 UTC m=+27.618533139" Jul 02 21:18:34.853204 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:34.853168 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqpwg" podStartSLOduration=3.370307131 podStartE2EDuration="26.853155806s" totalImagesPullingTime="23.482848675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:34.852766888 +0000 UTC m=+27.635137700" watchObservedRunningTime="2026-07-02 21:18:34.853155806 +0000 UTC m=+27.635526618" Jul 02 21:18:35.704089 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:35.704065 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:35.704316 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:35.704179 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:35.704316 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:35.704227 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:35.704392 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:35.704332 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:36.704231 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:36.704199 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:36.704447 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:36.704319 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:36.830310 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:36.830276 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="e6942615920d7b3543e17c9c5f9c77413192561d640e1e27e74386cfb7f9599b" exitCode=0 Jul 02 21:18:36.830467 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:36.830364 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"e6942615920d7b3543e17c9c5f9c77413192561d640e1e27e74386cfb7f9599b"} Jul 02 21:18:36.833719 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:36.833699 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"752f0d9693edc6b5adeaf3903c63098d82c6ac1cdc99b7ca86b2c35803743652"} Jul 02 21:18:37.704118 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:37.704087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:37.704277 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:37.704153 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:37.704277 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:37.704171 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:37.704277 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:37.704242 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:38.704229 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.704101 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:38.704618 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:38.704302 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:38.841258 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.841219 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" event={"ID":"a6517864-7395-4408-8cb1-d6387db8bbc3","Type":"ContainerStarted","Data":"30c7d39004d0a3f5efdb231b07c35c0d8a57d85423ad7d7cad77772984fead28"} Jul 02 21:18:38.841507 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.841465 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:38.841624 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.841540 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:38.843708 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.843684 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="2fe99d2b19c49f6beafc15f854d81de74d0ad6372411a58840d4efabdc6c7a15" exitCode=0 Jul 02 21:18:38.843818 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.843726 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"2fe99d2b19c49f6beafc15f854d81de74d0ad6372411a58840d4efabdc6c7a15"} Jul 02 21:18:38.857929 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.857910 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:38.870474 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:38.870421 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" podStartSLOduration=6.982173864 podStartE2EDuration="30.870403577s" totalImagesPullingTime="23.888229713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:38.869802038 +0000 UTC m=+31.652172855" watchObservedRunningTime="2026-07-02 21:18:38.870403577 +0000 UTC m=+31.652774391" Jul 02 21:18:39.703314 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:39.703285 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:39.703453 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:39.703414 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:39.703519 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:39.703470 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:39.703642 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:39.703613 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:39.846881 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:39.846851 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:39.864361 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:39.864339 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:18:40.704319 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.704292 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:40.704496 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:40.704419 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:40.952456 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.952423 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4bl5k"] Jul 02 21:18:40.952884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.952534 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:40.952884 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:40.952641 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:40.956395 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.956332 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjbmt"] Jul 02 21:18:40.956509 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.956417 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:40.956589 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:40.956531 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:40.958178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.958158 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z6f2h"] Jul 02 21:18:40.958272 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:40.958239 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:40.958330 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:40.958308 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:41.431907 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:41.431878 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:41.432070 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.431989 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:41.432070 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.432038 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.432024458 +0000 UTC m=+66.214395248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 21:18:41.532942 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:41.532905 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:41.533108 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:41.532963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:41.533108 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533066 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 21:18:41.533108 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533094 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 21:18:41.533108 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533094 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:41.533108 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533108 2585 projected.go:196] Error preparing data for projected volume kube-api-access-hmf6p for pod openshift-network-diagnostics/network-check-target-fjbmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:41.533323 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533160 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret podName:856de997-a6a6-44c1-9adc-48e93581b453 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.533141734 +0000 UTC m=+66.315512528 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret") pod "global-pull-secret-syncer-4bl5k" (UID: "856de997-a6a6-44c1-9adc-48e93581b453") : object "kube-system"/"original-pull-secret" not registered Jul 02 21:18:41.533323 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:41.533177 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p podName:b24790c8-637a-4c87-a4f0-baa145f8d751 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:13.53316727 +0000 UTC m=+66.315538068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmf6p" (UniqueName: "kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p") pod "network-check-target-fjbmt" (UID: "b24790c8-637a-4c87-a4f0-baa145f8d751") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 21:18:42.703856 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:42.703824 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:42.704325 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:42.703867 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:42.704325 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:42.703936 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:42.704325 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:42.703950 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:42.704325 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:42.704051 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:42.704325 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:42.704112 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:44.703854 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:44.703709 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:44.704129 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:44.703737 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:44.704129 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:44.703934 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6f2h" podUID="eeebab5a-bc8c-49c2-9bbe-95337a177513" Jul 02 21:18:44.704129 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:44.704003 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4bl5k" podUID="856de997-a6a6-44c1-9adc-48e93581b453" Jul 02 21:18:44.704129 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:44.703743 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:44.704129 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:44.704080 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjbmt" podUID="b24790c8-637a-4c87-a4f0-baa145f8d751" Jul 02 21:18:44.860820 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:44.860787 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="64e5767f5741e180059458cb87c486f8c07dcc4b5f5d221345e369f0e77a9e19" exitCode=0 Jul 02 21:18:44.860972 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:44.860842 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"64e5767f5741e180059458cb87c486f8c07dcc4b5f5d221345e369f0e77a9e19"} Jul 02 21:18:45.865592 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:45.865549 2585 generic.go:356] "Generic (PLEG): container finished" podID="f491b574-ab3f-467d-9344-ea16d3eb7abb" containerID="aafd651e91fb647f1435420ddb6660e06805d94050c67b70eeefdacd201c72ed" exitCode=0 Jul 02 21:18:45.866060 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:45.865604 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerDied","Data":"aafd651e91fb647f1435420ddb6660e06805d94050c67b70eeefdacd201c72ed"} Jul 02 21:18:46.463180 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.463154 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-1.ec2.internal" event="NodeReady" Jul 02 21:18:46.463296 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.463267 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 21:18:46.497074 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.497045 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c785d95-mc2pt"] Jul 02 21:18:46.499650 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.499635 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.501848 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.501826 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 21:18:46.502162 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.502134 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 21:18:46.502271 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.502171 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 21:18:46.502271 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.502138 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8l5qh\"" Jul 02 21:18:46.508062 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.508045 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 21:18:46.512607 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.512588 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v6cwv"] Jul 02 21:18:46.515612 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.515597 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.520616 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.520598 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 21:18:46.520713 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.520644 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 21:18:46.520769 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.520717 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sklqf\"" Jul 02 21:18:46.523488 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.523442 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c785d95-mc2pt"] Jul 02 21:18:46.524043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.524027 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lcfln"] Jul 02 21:18:46.527550 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.527532 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.533606 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.533586 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7htl\"" Jul 02 21:18:46.533727 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.533649 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6cwv"] Jul 02 21:18:46.533814 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.533745 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 21:18:46.533873 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.533831 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 21:18:46.533873 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.533836 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 21:18:46.549180 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.549158 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcfln"] Jul 02 21:18:46.569846 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569822 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6zmc\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.569940 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569851 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.569940 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.569940 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07af551a-b4e0-4399-9cab-dced5e118ab8-cert\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.569940 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569910 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569944 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.569960 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/461a0998-67f1-40bc-b911-cfd6ea3b59a4-config-volume\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570025 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92vqh\" (UniqueName: \"kubernetes.io/projected/461a0998-67f1-40bc-b911-cfd6ea3b59a4-kube-api-access-92vqh\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570043 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570061 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcsw9\" (UniqueName: \"kubernetes.io/projected/07af551a-b4e0-4399-9cab-dced5e118ab8-kube-api-access-fcsw9\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570076 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.570093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570090 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.570297 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570112 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.570297 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.570143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461a0998-67f1-40bc-b911-cfd6ea3b59a4-tmp-dir\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.671153 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07af551a-b4e0-4399-9cab-dced5e118ab8-cert\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.671153 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671380 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671380 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671193 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/461a0998-67f1-40bc-b911-cfd6ea3b59a4-config-volume\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.671380 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671370 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92vqh\" (UniqueName: \"kubernetes.io/projected/461a0998-67f1-40bc-b911-cfd6ea3b59a4-kube-api-access-92vqh\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.671524 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671524 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcsw9\" (UniqueName: \"kubernetes.io/projected/07af551a-b4e0-4399-9cab-dced5e118ab8-kube-api-access-fcsw9\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.671524 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671442 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:46.671563 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:46.671596 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671636 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461a0998-67f1-40bc-b911-cfd6ea3b59a4-tmp-dir\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.671903 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:46.671689 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:47.171668782 +0000 UTC m=+39.954039583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:18:46.671903 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671720 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6zmc\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671903 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.671903 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671780 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.672091 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671912 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461a0998-67f1-40bc-b911-cfd6ea3b59a4-tmp-dir\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.672091 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.671921 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/461a0998-67f1-40bc-b911-cfd6ea3b59a4-config-volume\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.672091 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:46.671920 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:46.672091 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:46.672005 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:47.171988323 +0000 UTC m=+39.954359114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:18:46.675346 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.675320 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.675445 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.675344 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.675445 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.675432 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07af551a-b4e0-4399-9cab-dced5e118ab8-cert\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.682521 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.682503 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.682863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.682845 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.686311 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.686290 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92vqh\" (UniqueName: \"kubernetes.io/projected/461a0998-67f1-40bc-b911-cfd6ea3b59a4-kube-api-access-92vqh\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:46.693732 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.693710 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcsw9\" (UniqueName: \"kubernetes.io/projected/07af551a-b4e0-4399-9cab-dced5e118ab8-kube-api-access-fcsw9\") pod \"ingress-canary-lcfln\" (UID: \"07af551a-b4e0-4399-9cab-dced5e118ab8\") " pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.694041 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.694025 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6zmc\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.695932 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.695912 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:46.703658 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.703639 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:18:46.703658 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.703650 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:18:46.703762 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.703639 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:18:46.711114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711096 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:18:46.711212 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711199 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:18:46.711347 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711327 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:18:46.711468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711361 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:18:46.711468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711411 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k252\"" Jul 02 21:18:46.711468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.711422 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjnbk\"" Jul 02 21:18:46.835234 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.835202 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcfln" Jul 02 21:18:46.871982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.871945 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" event={"ID":"f491b574-ab3f-467d-9344-ea16d3eb7abb","Type":"ContainerStarted","Data":"b262cec7ae60b5bf28b8d5027ca932f69a10dd45c339e2a0256d0af3b15be235"} Jul 02 21:18:46.896585 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:46.896532 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z5hhs" podStartSLOduration=6.367705576 podStartE2EDuration="37.896509462s" totalImagesPullingTime="31.528803886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:46.895290788 +0000 UTC m=+39.677661601" watchObservedRunningTime="2026-07-02 21:18:46.896509462 +0000 UTC m=+39.678880275" Jul 02 21:18:47.022484 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.022267 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcfln"] Jul 02 21:18:47.025756 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:18:47.025730 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07af551a_b4e0_4399_9cab_dced5e118ab8.slice/crio-fcaccd5bc5627c2f07de5ddec337d47f2f085b9bf71786a26e5a9c9e36bdea51 WatchSource:0}: Error finding container fcaccd5bc5627c2f07de5ddec337d47f2f085b9bf71786a26e5a9c9e36bdea51: Status 404 returned error can't find the container with id fcaccd5bc5627c2f07de5ddec337d47f2f085b9bf71786a26e5a9c9e36bdea51 Jul 02 21:18:47.038849 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.038824 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:47.130885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.130772 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:47.175883 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.175856 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:47.175982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.175892 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:47.176019 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:47.175988 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:47.176019 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:47.176003 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:47.176019 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:47.176016 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:18:47.176111 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:47.176034 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:48.176022646 +0000 UTC m=+40.958393438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:18:47.176111 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:47.176069 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:48.176053173 +0000 UTC m=+40.958423984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:18:47.548166 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.548131 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:47.606181 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.606144 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:47.876240 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:47.876151 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcfln" event={"ID":"07af551a-b4e0-4399-9cab-dced5e118ab8","Type":"ContainerStarted","Data":"fcaccd5bc5627c2f07de5ddec337d47f2f085b9bf71786a26e5a9c9e36bdea51"} Jul 02 21:18:48.157039 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.156939 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:48.183956 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.183925 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:48.184128 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.183971 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:48.184128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:48.184082 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:48.184128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:48.184089 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:48.184128 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:48.184108 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:18:48.184345 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:48.184149 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:50.184131507 +0000 UTC m=+42.966502309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:18:48.184345 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:48.184168 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:50.184158272 +0000 UTC m=+42.966529082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:18:48.233159 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.233116 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:48.335221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.335189 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:48.431630 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.431540 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:48.532178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:48.532145 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:49.256052 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.256011 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:49.359900 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.359871 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:49.615871 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.615843 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:49.716459 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.716419 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:49.882211 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.882126 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcfln" event={"ID":"07af551a-b4e0-4399-9cab-dced5e118ab8","Type":"ContainerStarted","Data":"7c19f1ee3184a5c03df518964d268879d73c57ae344684dd7f4c9bc30c0fff82"} Jul 02 21:18:49.906297 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:49.906250 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lcfln" podStartSLOduration=1.253544913 podStartE2EDuration="3.906233769s" totalImagesPullingTime="2.652688856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:18:49.905487538 +0000 UTC m=+42.687858347" watchObservedRunningTime="2026-07-02 21:18:49.906233769 +0000 UTC m=+42.688604582" Jul 02 21:18:50.200876 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:50.200798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:50.200876 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:50.200837 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:50.201080 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:50.200956 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:50.201080 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:50.201010 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:54.200997651 +0000 UTC m=+46.983368441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:18:50.201080 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:50.200959 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:50.201080 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:50.201049 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:18:50.201234 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:50.201104 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:18:54.201079135 +0000 UTC m=+46.983449932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:18:54.229706 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:54.229523 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:54.229725 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:54.229684 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:54.229788 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:54.229843 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:02.229823218 +0000 UTC m=+55.012194009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:54.229866 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:18:54.230136 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:18:54.229945 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:02.229926905 +0000 UTC m=+55.012297699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:18:55.555613 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:55.555560 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:18:55.619769 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:18:55.619737 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:02.286962 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:02.286925 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:19:02.286962 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:02.286964 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:19:02.287421 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:02.287072 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:02.287421 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:02.287076 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:02.287421 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:02.287096 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:19:02.287421 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:02.287122 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:18.287109045 +0000 UTC m=+71.069479836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:19:02.287421 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:02.287147 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:18.287133551 +0000 UTC m=+71.069504343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:19:02.551020 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:02.550936 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:02.608905 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:02.608873 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:05.307995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:05.307956 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:05.415507 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:05.415473 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:05.504885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:05.504852 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:05.605410 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:05.605341 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:05.705022 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:05.704991 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:10.286614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:10.286554 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:10.387612 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:10.387581 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:11.299138 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:11.299101 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:11.861758 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:11.861733 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jhw2p" Jul 02 21:19:12.584690 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:12.584654 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:13.268354 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.268317 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:13.465595 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.465537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:19:13.468356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.468340 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 21:19:13.476443 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:13.476429 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 21:19:13.476487 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:13.476480 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs podName:eeebab5a-bc8c-49c2-9bbe-95337a177513 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:17.476465121 +0000 UTC m=+130.258835912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs") pod "network-metrics-daemon-z6f2h" (UID: "eeebab5a-bc8c-49c2-9bbe-95337a177513") : secret "metrics-daemon-secret" not found Jul 02 21:19:13.566469 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.566437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:19:13.566649 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.566475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:19:13.569349 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.569331 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 21:19:13.569349 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.569342 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 21:19:13.579092 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.579074 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 21:19:13.580057 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.580038 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/856de997-a6a6-44c1-9adc-48e93581b453-original-pull-secret\") pod \"global-pull-secret-syncer-4bl5k\" (UID: \"856de997-a6a6-44c1-9adc-48e93581b453\") " pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:19:13.589081 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.589055 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmf6p\" (UniqueName: \"kubernetes.io/projected/b24790c8-637a-4c87-a4f0-baa145f8d751-kube-api-access-hmf6p\") pod \"network-check-target-fjbmt\" (UID: \"b24790c8-637a-4c87-a4f0-baa145f8d751\") " pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:19:13.721317 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.721284 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjnbk\"" Jul 02 21:19:13.723262 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.723247 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4bl5k" Jul 02 21:19:13.728750 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.728735 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:19:13.886001 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.885969 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjbmt"] Jul 02 21:19:13.889558 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:13.889533 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24790c8_637a_4c87_a4f0_baa145f8d751.slice/crio-f71a2f64b2d1c3a7154ae07419a674aaaf0defec3edd5254c87e14a6d7bc77d4 WatchSource:0}: Error finding container f71a2f64b2d1c3a7154ae07419a674aaaf0defec3edd5254c87e14a6d7bc77d4: Status 404 returned error can't find the container with id f71a2f64b2d1c3a7154ae07419a674aaaf0defec3edd5254c87e14a6d7bc77d4 Jul 02 21:19:13.892643 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.892612 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4bl5k"] Jul 02 21:19:13.896073 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:13.896050 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856de997_a6a6_44c1_9adc_48e93581b453.slice/crio-3243b5c8dadb408e2b8f88710a3d053f6c319094de9353c6671cc32e6a3f5b2d WatchSource:0}: Error finding container 3243b5c8dadb408e2b8f88710a3d053f6c319094de9353c6671cc32e6a3f5b2d: Status 404 returned error can't find the container with id 3243b5c8dadb408e2b8f88710a3d053f6c319094de9353c6671cc32e6a3f5b2d Jul 02 21:19:13.937862 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.937835 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjbmt" event={"ID":"b24790c8-637a-4c87-a4f0-baa145f8d751","Type":"ContainerStarted","Data":"f71a2f64b2d1c3a7154ae07419a674aaaf0defec3edd5254c87e14a6d7bc77d4"} Jul 02 21:19:13.938866 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:13.938846 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4bl5k" event={"ID":"856de997-a6a6-44c1-9adc-48e93581b453","Type":"ContainerStarted","Data":"3243b5c8dadb408e2b8f88710a3d053f6c319094de9353c6671cc32e6a3f5b2d"} Jul 02 21:19:17.950684 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:17.950653 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjbmt" event={"ID":"b24790c8-637a-4c87-a4f0-baa145f8d751","Type":"ContainerStarted","Data":"7f13924e514bab0d5fa9331f5012ae0d77b0f40768531fdb7ff4c9219c5baf95"} Jul 02 21:19:17.951028 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:17.950787 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:19:17.971713 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:17.971670 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fjbmt" podStartSLOduration=66.098524884 podStartE2EDuration="1m9.971655197s" totalImagesPullingTime="3.873130313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:17.970325628 +0000 UTC m=+70.752696441" watchObservedRunningTime="2026-07-02 21:19:17.971655197 +0000 UTC m=+70.754026313" Jul 02 21:19:18.306265 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:18.306232 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:19:18.306265 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:18.306269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:19:18.306482 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:18.306385 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:18.306482 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:18.306396 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:18.306482 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:18.306417 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:19:18.306482 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:18.306453 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:50.306434851 +0000 UTC m=+103.088805643 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:19:18.306482 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:18.306473 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:50.306464127 +0000 UTC m=+103.088834918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:19:19.957181 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:19.957143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4bl5k" event={"ID":"856de997-a6a6-44c1-9adc-48e93581b453","Type":"ContainerStarted","Data":"be419b024068bd804a5812a61b7ea926549282ce03d7f83f36f83a8c0b5994a3"} Jul 02 21:19:19.975220 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:19.975167 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4bl5k" podStartSLOduration=65.429298534 podStartE2EDuration="1m10.975153869s" totalImagesPullingTime="5.545855335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:19.973901369 +0000 UTC m=+72.756272182" watchObservedRunningTime="2026-07-02 21:19:19.975153869 +0000 UTC m=+72.757524681" Jul 02 21:19:22.548768 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:22.548729 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:22.611114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:22.611085 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:26.905850 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:26.905819 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.007426 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.007390 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.391210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.391176 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.486056 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.486025 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.642194 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.642091 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.746644 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.746613 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.853275 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.853223 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:27.956044 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:27.955957 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:28.658269 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:28.658230 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:28.758624 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:28.758592 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:28.823177 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:28.823145 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:29.608959 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:29.608925 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:39.676027 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:39.675995 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:39.773939 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:39.773888 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:41.784840 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:41.784802 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:41.908795 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:41.908762 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:41.994831 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:41.994798 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:44.797032 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:44.796989 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:44.896096 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:44.896053 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:48.956017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:48.955988 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fjbmt" Jul 02 21:19:49.359217 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:49.359159 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:49.428477 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:49.428447 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:50.326985 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.326954 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") pod \"image-registry-67c785d95-mc2pt\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.326994 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:50.327109 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:50.327173 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls podName:461a0998-67f1-40bc-b911-cfd6ea3b59a4 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:54.327154967 +0000 UTC m=+167.109525776 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls") pod "dns-default-v6cwv" (UID: "461a0998-67f1-40bc-b911-cfd6ea3b59a4") : secret "dns-default-metrics-tls" not found Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:50.327112 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:50.327202 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c785d95-mc2pt: secret "image-registry-tls" not found Jul 02 21:19:50.327460 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:50.327245 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls podName:1dcdc85c-83a7-4946-90f3-06846857f9a3 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:54.327233534 +0000 UTC m=+167.109604324 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls") pod "image-registry-67c785d95-mc2pt" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3") : secret "image-registry-tls" not found Jul 02 21:19:50.465485 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.465450 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8llqz"] Jul 02 21:19:50.494350 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.494325 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8llqz"] Jul 02 21:19:50.494611 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.494589 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.498447 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.498342 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 21:19:50.504884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.504861 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.504884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.504879 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-25vx7\"" Jul 02 21:19:50.504998 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.504906 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.505522 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.505508 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 21:19:50.529237 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.529216 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 21:19:50.564612 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.564583 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg"] Jul 02 21:19:50.589817 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.589758 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg"] Jul 02 21:19:50.589911 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.589843 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" Jul 02 21:19:50.592198 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.592170 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8k9rp\"" Jul 02 21:19:50.629263 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.629240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-config\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.629358 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.629279 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klthd\" (UniqueName: \"kubernetes.io/projected/9d089307-285b-4f9d-8234-3cf63df3f387-kube-api-access-klthd\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.629358 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.629309 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-trusted-ca\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.629358 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.629343 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d089307-285b-4f9d-8234-3cf63df3f387-serving-cert\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.667786 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.667761 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x"] Jul 02 21:19:50.691481 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.691460 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x"] Jul 02 21:19:50.691607 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.691549 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" Jul 02 21:19:50.694433 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.694415 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2zhzl\"" Jul 02 21:19:50.694702 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.694685 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 21:19:50.694785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.694689 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 21:19:50.725994 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.725967 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:50.729863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.729844 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klthd\" (UniqueName: \"kubernetes.io/projected/9d089307-285b-4f9d-8234-3cf63df3f387-kube-api-access-klthd\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.729982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.729875 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-trusted-ca\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.729982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.729898 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28m2\" (UniqueName: \"kubernetes.io/projected/2b34acaa-8cc3-48fe-a8af-3a3229d83778-kube-api-access-s28m2\") pod \"network-check-source-989f8b8dc-zt5xg\" (UID: \"2b34acaa-8cc3-48fe-a8af-3a3229d83778\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" Jul 02 21:19:50.729982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.729927 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d089307-285b-4f9d-8234-3cf63df3f387-serving-cert\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.729982 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.729967 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-config\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.730499 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.730480 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-config\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.730694 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.730679 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d089307-285b-4f9d-8234-3cf63df3f387-trusted-ca\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.732282 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.732259 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d089307-285b-4f9d-8234-3cf63df3f387-serving-cert\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.738838 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.738816 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klthd\" (UniqueName: \"kubernetes.io/projected/9d089307-285b-4f9d-8234-3cf63df3f387-kube-api-access-klthd\") pod \"console-operator-68b757fb67-8llqz\" (UID: \"9d089307-285b-4f9d-8234-3cf63df3f387\") " pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.804710 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.804681 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:50.826626 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.826594 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:50.830525 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.830261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28m2\" (UniqueName: \"kubernetes.io/projected/2b34acaa-8cc3-48fe-a8af-3a3229d83778-kube-api-access-s28m2\") pod \"network-check-source-989f8b8dc-zt5xg\" (UID: \"2b34acaa-8cc3-48fe-a8af-3a3229d83778\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" Jul 02 21:19:50.830525 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.830298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hng\" (UniqueName: \"kubernetes.io/projected/f666eb2f-559c-4ea5-a2eb-fdd68ed888a9-kube-api-access-g9hng\") pod \"volume-data-source-validator-5d456fdbcd-8gr8x\" (UID: \"f666eb2f-559c-4ea5-a2eb-fdd68ed888a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" Jul 02 21:19:50.839867 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.839820 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28m2\" (UniqueName: \"kubernetes.io/projected/2b34acaa-8cc3-48fe-a8af-3a3229d83778-kube-api-access-s28m2\") pod \"network-check-source-989f8b8dc-zt5xg\" (UID: \"2b34acaa-8cc3-48fe-a8af-3a3229d83778\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" Jul 02 21:19:50.898463 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.898428 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" Jul 02 21:19:50.926038 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.925992 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:50.930848 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.930824 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hng\" (UniqueName: \"kubernetes.io/projected/f666eb2f-559c-4ea5-a2eb-fdd68ed888a9-kube-api-access-g9hng\") pod \"volume-data-source-validator-5d456fdbcd-8gr8x\" (UID: \"f666eb2f-559c-4ea5-a2eb-fdd68ed888a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" Jul 02 21:19:50.944741 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.944714 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hng\" (UniqueName: \"kubernetes.io/projected/f666eb2f-559c-4ea5-a2eb-fdd68ed888a9-kube-api-access-g9hng\") pod \"volume-data-source-validator-5d456fdbcd-8gr8x\" (UID: \"f666eb2f-559c-4ea5-a2eb-fdd68ed888a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" Jul 02 21:19:50.958107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.958050 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8llqz"] Jul 02 21:19:50.960824 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:50.960803 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d089307_285b_4f9d_8234_3cf63df3f387.slice/crio-bb2d8ea7abc972791076f5d246f01e403950fbcd3ac6a7cd9b9e388dd7329755 WatchSource:0}: Error finding container bb2d8ea7abc972791076f5d246f01e403950fbcd3ac6a7cd9b9e388dd7329755: Status 404 returned error can't find the container with id bb2d8ea7abc972791076f5d246f01e403950fbcd3ac6a7cd9b9e388dd7329755 Jul 02 21:19:50.999820 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:50.999785 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" Jul 02 21:19:51.026455 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:51.026419 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:51.028645 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:51.028622 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerStarted","Data":"bb2d8ea7abc972791076f5d246f01e403950fbcd3ac6a7cd9b9e388dd7329755"} Jul 02 21:19:51.039739 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:51.039714 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg"] Jul 02 21:19:51.042918 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:51.042895 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b34acaa_8cc3_48fe_a8af_3a3229d83778.slice/crio-cb8f3cbb58e032494550d268a73317cf055c4c4085a33d4e27e830abcd7b5061 WatchSource:0}: Error finding container cb8f3cbb58e032494550d268a73317cf055c4c4085a33d4e27e830abcd7b5061: Status 404 returned error can't find the container with id cb8f3cbb58e032494550d268a73317cf055c4c4085a33d4e27e830abcd7b5061 Jul 02 21:19:51.144951 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:51.144934 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x"] Jul 02 21:19:51.147082 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:51.147058 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf666eb2f_559c_4ea5_a2eb_fdd68ed888a9.slice/crio-ce4462121e7a4645c9ed838fc0900bad1683f159ced2a9dedfcb7b061c89630b WatchSource:0}: Error finding container ce4462121e7a4645c9ed838fc0900bad1683f159ced2a9dedfcb7b061c89630b: Status 404 returned error can't find the container with id ce4462121e7a4645c9ed838fc0900bad1683f159ced2a9dedfcb7b061c89630b Jul 02 21:19:52.032873 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:52.032838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" event={"ID":"2b34acaa-8cc3-48fe-a8af-3a3229d83778","Type":"ContainerStarted","Data":"c7fb7bb14f22d11f2f1f71f4804816272582066d9d625b2ec96750fb5f6ab6e4"} Jul 02 21:19:52.033325 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:52.032894 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" event={"ID":"2b34acaa-8cc3-48fe-a8af-3a3229d83778","Type":"ContainerStarted","Data":"cb8f3cbb58e032494550d268a73317cf055c4c4085a33d4e27e830abcd7b5061"} Jul 02 21:19:52.034032 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:52.033999 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" event={"ID":"f666eb2f-559c-4ea5-a2eb-fdd68ed888a9","Type":"ContainerStarted","Data":"ce4462121e7a4645c9ed838fc0900bad1683f159ced2a9dedfcb7b061c89630b"} Jul 02 21:19:53.039015 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.038972 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerStarted","Data":"2bfd8cadc627437ba6d6b86954fc7703aa5fe469c713a4d5f69ec1a902416611"} Jul 02 21:19:53.039452 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.039157 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:19:53.040321 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.040238 2585 patch_prober.go:28] interesting pod/console-operator-68b757fb67-8llqz container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Jul 02 21:19:53.040321 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.040299 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Jul 02 21:19:53.040750 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.040688 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" event={"ID":"f666eb2f-559c-4ea5-a2eb-fdd68ed888a9","Type":"ContainerStarted","Data":"e6ab509f0d3f944bf7fd13b335457b2a46f32288fb610fd5a759043ca85ba1e1"} Jul 02 21:19:53.061617 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.061556 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zt5xg" podStartSLOduration=3.061542767 podStartE2EDuration="3.061542767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:52.052489624 +0000 UTC m=+104.834860437" watchObservedRunningTime="2026-07-02 21:19:53.061542767 +0000 UTC m=+105.843913558" Jul 02 21:19:53.061801 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.061780 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podStartSLOduration=1.094574338 podStartE2EDuration="3.061774513s" totalImagesPullingTime="1.967200175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:53.060918212 +0000 UTC m=+105.843289025" watchObservedRunningTime="2026-07-02 21:19:53.061774513 +0000 UTC m=+105.844145325" Jul 02 21:19:53.084366 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.084325 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8gr8x" podStartSLOduration=1.3075708910000001 podStartE2EDuration="3.084310535s" totalImagesPullingTime="1.776739644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:19:53.083060375 +0000 UTC m=+105.865431188" watchObservedRunningTime="2026-07-02 21:19:53.084310535 +0000 UTC m=+105.866681348" Jul 02 21:19:53.198987 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.198892 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:53.301955 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:53.301921 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:54.045158 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.045130 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/0.log" Jul 02 21:19:54.045655 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.045168 2585 generic.go:356] "Generic (PLEG): container finished" podID="9d089307-285b-4f9d-8234-3cf63df3f387" containerID="2bfd8cadc627437ba6d6b86954fc7703aa5fe469c713a4d5f69ec1a902416611" exitCode=255 Jul 02 21:19:54.045655 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.045271 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerDied","Data":"2bfd8cadc627437ba6d6b86954fc7703aa5fe469c713a4d5f69ec1a902416611"} Jul 02 21:19:54.045655 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.045496 2585 scope.go:117] "RemoveContainer" containerID="2bfd8cadc627437ba6d6b86954fc7703aa5fe469c713a4d5f69ec1a902416611" Jul 02 21:19:54.610806 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.610773 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kw9lq"] Jul 02 21:19:54.612820 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.612807 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.615412 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.615393 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 21:19:54.615530 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.615398 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 21:19:54.619290 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.619270 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 21:19:54.619383 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.619317 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zd4gb\"" Jul 02 21:19:54.619641 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.619621 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 21:19:54.632804 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.632779 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kw9lq"] Jul 02 21:19:54.659169 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.659140 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.659275 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.659174 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.659275 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.659252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98e32025-53ea-4903-81d6-64e91bff53b5-crio-socket\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.659343 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.659288 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98e32025-53ea-4903-81d6-64e91bff53b5-data-volume\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.659376 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.659346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdcnh\" (UniqueName: \"kubernetes.io/projected/98e32025-53ea-4903-81d6-64e91bff53b5-kube-api-access-fdcnh\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.725163 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.725132 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:54.760303 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760271 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdcnh\" (UniqueName: \"kubernetes.io/projected/98e32025-53ea-4903-81d6-64e91bff53b5-kube-api-access-fdcnh\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760429 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760314 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760429 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760342 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760429 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:54.760404 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760409 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98e32025-53ea-4903-81d6-64e91bff53b5-crio-socket\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:54.760475 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.260456965 +0000 UTC m=+108.042827758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : configmap "kube-rbac-proxy" not found Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:54.760503 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760475 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98e32025-53ea-4903-81d6-64e91bff53b5-crio-socket\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760532 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98e32025-53ea-4903-81d6-64e91bff53b5-data-volume\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.760610 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:54.760566 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:55.260553294 +0000 UTC m=+108.042924084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:54.760833 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.760817 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98e32025-53ea-4903-81d6-64e91bff53b5-data-volume\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.772968 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.772944 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdcnh\" (UniqueName: \"kubernetes.io/projected/98e32025-53ea-4903-81d6-64e91bff53b5-kube-api-access-fdcnh\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:54.806484 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:54.806463 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:55.043463 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.043428 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:55.049656 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.049637 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/1.log" Jul 02 21:19:55.049995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.049951 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/0.log" Jul 02 21:19:55.049995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.049984 2585 generic.go:356] "Generic (PLEG): container finished" podID="9d089307-285b-4f9d-8234-3cf63df3f387" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" exitCode=255 Jul 02 21:19:55.050068 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.050032 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerDied","Data":"0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1"} Jul 02 21:19:55.050106 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.050098 2585 scope.go:117] "RemoveContainer" containerID="2bfd8cadc627437ba6d6b86954fc7703aa5fe469c713a4d5f69ec1a902416611" Jul 02 21:19:55.050321 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.050302 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:19:55.050511 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:55.050489 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:19:55.265052 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.264998 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:55.265052 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.265058 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:55.265244 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:55.265143 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:55.265244 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:55.265190 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:55.265244 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:55.265212 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:56.265193631 +0000 UTC m=+109.047564427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : configmap "kube-rbac-proxy" not found Jul 02 21:19:55.265244 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:55.265230 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:56.265221152 +0000 UTC m=+109.047591947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:55.491472 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.491403 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:55.590323 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.590283 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:55.694313 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.694280 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:55.790706 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:55.790670 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:56.054226 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:56.054158 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/1.log" Jul 02 21:19:56.054594 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:56.054470 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:19:56.054653 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:56.054633 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:19:56.272168 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:56.272134 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:56.272168 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:56.272172 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:56.272394 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:56.272261 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:56.272394 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:56.272273 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:56.272394 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:56.272328 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.272314896 +0000 UTC m=+111.054685687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:56.272394 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:56.272342 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:19:58.272335184 +0000 UTC m=+111.054705976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : configmap "kube-rbac-proxy" not found Jul 02 21:19:56.716079 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:56.716048 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nh5kn_1c93a01a-5785-4859-b6d4-90c8c5f07a69/dns-node-resolver/0.log" Jul 02 21:19:57.360856 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.360824 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xr6c9"] Jul 02 21:19:57.363662 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.363645 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.370124 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.370101 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 21:19:57.370565 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.370548 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 21:19:57.370651 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.370549 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 21:19:57.370878 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.370863 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 21:19:57.370961 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.370895 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nl87f\"" Jul 02 21:19:57.376270 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.376254 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xr6c9"] Jul 02 21:19:57.379910 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.379890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-key\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.380000 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.379935 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-cabundle\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.380052 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.380019 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrn2t\" (UniqueName: \"kubernetes.io/projected/0f7b886e-968a-40e1-a397-c1ed38532b5a-kube-api-access-hrn2t\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.407240 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.407211 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:57.463276 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.463247 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:19:57.480363 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.480337 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-key\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.480471 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.480380 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-cabundle\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.480541 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.480521 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrn2t\" (UniqueName: \"kubernetes.io/projected/0f7b886e-968a-40e1-a397-c1ed38532b5a-kube-api-access-hrn2t\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.481184 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.481162 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-cabundle\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.482748 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.482728 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f7b886e-968a-40e1-a397-c1ed38532b5a-signing-key\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.489387 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.489367 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrn2t\" (UniqueName: \"kubernetes.io/projected/0f7b886e-968a-40e1-a397-c1ed38532b5a-kube-api-access-hrn2t\") pod \"service-ca-758f599c5-xr6c9\" (UID: \"0f7b886e-968a-40e1-a397-c1ed38532b5a\") " pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.520175 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.520154 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lq79g_72bc5134-5e61-4304-a9b4-044233245391/node-ca/0.log" Jul 02 21:19:57.672589 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.672511 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xr6c9" Jul 02 21:19:57.794372 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:57.794256 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xr6c9"] Jul 02 21:19:57.796683 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:19:57.796653 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7b886e_968a_40e1_a397_c1ed38532b5a.slice/crio-4cdbe032cac010fa2e4b7ceebe33318db210c5a19ce9824a1e8077e117cce189 WatchSource:0}: Error finding container 4cdbe032cac010fa2e4b7ceebe33318db210c5a19ce9824a1e8077e117cce189: Status 404 returned error can't find the container with id 4cdbe032cac010fa2e4b7ceebe33318db210c5a19ce9824a1e8077e117cce189 Jul 02 21:19:58.061776 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:58.061745 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xr6c9" event={"ID":"0f7b886e-968a-40e1-a397-c1ed38532b5a","Type":"ContainerStarted","Data":"4cdbe032cac010fa2e4b7ceebe33318db210c5a19ce9824a1e8077e117cce189"} Jul 02 21:19:58.117408 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:58.117382 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcfln_07af551a-b4e0-4399-9cab-dced5e118ab8/serve-healthcheck-canary/0.log" Jul 02 21:19:58.285079 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:58.285046 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:58.285259 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:58.285139 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:19:58.285259 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:58.285228 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:19:58.285367 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:58.285293 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.285275978 +0000 UTC m=+115.067646770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : configmap "kube-rbac-proxy" not found Jul 02 21:19:58.285367 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:58.285228 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:19:58.285472 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:19:58.285383 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:02.285365866 +0000 UTC m=+115.067736660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:19:58.336774 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:19:58.336708 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:00.067777 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:00.067740 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xr6c9" event={"ID":"0f7b886e-968a-40e1-a397-c1ed38532b5a","Type":"ContainerStarted","Data":"35e7761f02651aac788c07440a94e43b9be1ca89752a7b283b529e5e08fc0206"} Jul 02 21:20:00.085731 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:00.085673 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-xr6c9" podStartSLOduration=1.190455929 podStartE2EDuration="3.085652506s" totalImagesPullingTime="1.895196577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:00.084134621 +0000 UTC m=+112.866505435" watchObservedRunningTime="2026-07-02 21:20:00.085652506 +0000 UTC m=+112.868023321" Jul 02 21:20:00.804884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:00.804858 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:00.805188 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:00.805175 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:20:00.805334 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:00.805316 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:01.092934 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.092839 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.224370 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.224324 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.326037 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.325990 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.431288 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.431147 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.531585 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.531535 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.630880 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.630845 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:01.829125 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:01.829091 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:02.196266 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:02.196182 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:02.316804 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:02.316762 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:02.316994 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:02.316866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:02.316994 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:02.316907 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:20:02.316994 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:02.316967 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 21:20:02.317137 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:02.316969 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.316953016 +0000 UTC m=+123.099323812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:20:02.317137 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:02.317048 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:10.317031873 +0000 UTC m=+123.099402664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : configmap "kube-rbac-proxy" not found Jul 02 21:20:03.039463 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:03.039426 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:03.039816 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:03.039802 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:20:03.039962 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:03.039943 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:03.485187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:03.485081 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:03.672610 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:03.672558 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:03.836902 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:03.836868 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:04.076516 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:04.076484 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:04.216995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:04.216913 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:04.831973 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:04.831944 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:04.962757 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:04.962722 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:05.200728 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:05.200649 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:05.575428 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:05.575393 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:05.778955 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:05.778911 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:05.840618 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:05.840529 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:05.992979 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:05.992951 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:06.181699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:06.181609 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:07.419813 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:07.419774 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:07.582133 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:07.582095 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:07.761026 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:07.760936 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:07.844067 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:07.844033 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:07.972114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:07.972085 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:08.188373 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:08.188339 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:08.263891 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:08.263859 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:09.180423 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:09.180386 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:09.600275 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:09.600243 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:09.803126 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:09.803089 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:10.024027 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.023938 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:10.377854 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.377829 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:10.378264 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.377884 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:10.378264 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:10.377985 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 21:20:10.378264 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:10.378043 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls podName:98e32025-53ea-4903-81d6-64e91bff53b5 nodeName:}" failed. No retries permitted until 2026-07-02 21:20:26.378026256 +0000 UTC m=+139.160397048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kw9lq" (UID: "98e32025-53ea-4903-81d6-64e91bff53b5") : secret "insights-runtime-extractor-tls" not found Jul 02 21:20:10.378377 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.378350 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98e32025-53ea-4903-81d6-64e91bff53b5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:10.390579 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.390540 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:10.737848 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.737765 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:10.983017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:10.982981 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:11.193606 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:11.193554 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:11.585759 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:11.585725 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:11.779078 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:11.779032 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:17.531983 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.531933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:20:17.534147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.534123 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeebab5a-bc8c-49c2-9bbe-95337a177513-metrics-certs\") pod \"network-metrics-daemon-z6f2h\" (UID: \"eeebab5a-bc8c-49c2-9bbe-95337a177513\") " pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:20:17.569613 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.569552 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:17.616153 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.616126 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6k252\"" Jul 02 21:20:17.624233 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.624218 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6f2h" Jul 02 21:20:17.671406 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.670915 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:17.706157 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.706132 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:20:17.752964 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:17.752934 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z6f2h"] Jul 02 21:20:17.756583 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:17.756540 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeebab5a_bc8c_49c2_9bbe_95337a177513.slice/crio-7d52815c86f7f1cc9003fdb722cb4aff385ccab76aa77ca2b1a2abae39e23427 WatchSource:0}: Error finding container 7d52815c86f7f1cc9003fdb722cb4aff385ccab76aa77ca2b1a2abae39e23427: Status 404 returned error can't find the container with id 7d52815c86f7f1cc9003fdb722cb4aff385ccab76aa77ca2b1a2abae39e23427 Jul 02 21:20:18.120534 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.120459 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:20:18.120922 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.120900 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/1.log" Jul 02 21:20:18.121026 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.120946 2585 generic.go:356] "Generic (PLEG): container finished" podID="9d089307-285b-4f9d-8234-3cf63df3f387" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" exitCode=255 Jul 02 21:20:18.121075 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.121057 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerDied","Data":"34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb"} Jul 02 21:20:18.121144 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.121123 2585 scope.go:117] "RemoveContainer" containerID="0f92d1598104545e1c190b5de5eb134205480a5eebc596af8d1b12b48f7fc4a1" Jul 02 21:20:18.121506 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.121485 2585 scope.go:117] "RemoveContainer" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" Jul 02 21:20:18.121718 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:18.121697 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:18.122384 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:18.122364 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6f2h" event={"ID":"eeebab5a-bc8c-49c2-9bbe-95337a177513","Type":"ContainerStarted","Data":"7d52815c86f7f1cc9003fdb722cb4aff385ccab76aa77ca2b1a2abae39e23427"} Jul 02 21:20:19.127642 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:19.127617 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:20:19.129205 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:19.129174 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6f2h" event={"ID":"eeebab5a-bc8c-49c2-9bbe-95337a177513","Type":"ContainerStarted","Data":"bd196b80244641404a553001020c139eb358d9536a82ad780787b6774aeb2a43"} Jul 02 21:20:19.129327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:19.129219 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6f2h" event={"ID":"eeebab5a-bc8c-49c2-9bbe-95337a177513","Type":"ContainerStarted","Data":"405cb3e9201a3a5eaccc7220f2a7178fb6d786ff84c84f1aa92af25baefbb5d7"} Jul 02 21:20:19.151443 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:19.151397 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z6f2h" podStartSLOduration=130.359788979 podStartE2EDuration="2m11.151383538s" totalImagesPullingTime="791.594559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:19.150929387 +0000 UTC m=+131.933300202" watchObservedRunningTime="2026-07-02 21:20:19.151383538 +0000 UTC m=+131.933754351" Jul 02 21:20:20.340607 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.340562 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm"] Jul 02 21:20:20.342647 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.342632 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.347484 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.347459 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 21:20:20.348241 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.348223 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 21:20:20.350914 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.350896 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 21:20:20.351065 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.351048 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 21:20:20.351536 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.351524 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 21:20:20.351605 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.351556 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 21:20:20.351605 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.351589 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 21:20:20.370148 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.370127 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm"] Jul 02 21:20:20.455661 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455633 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.455661 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455662 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.455838 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455681 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.455838 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.455838 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455787 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.455932 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.455856 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4dw\" (UniqueName: \"kubernetes.io/projected/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-kube-api-access-fr4dw\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.539307 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.539275 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:20.556166 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556136 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4dw\" (UniqueName: \"kubernetes.io/projected/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-kube-api-access-fr4dw\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.556303 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556184 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.556303 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556202 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.556303 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556218 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.556303 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556237 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.556537 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.556368 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.557127 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.557100 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.558777 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.558756 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.558866 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.558824 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.558913 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.558865 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-ca\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.558913 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.558896 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-hub\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.566137 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.566101 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4dw\" (UniqueName: \"kubernetes.io/projected/edb3d3c6-2ed6-42fc-852b-8dde57f54fec-kube-api-access-fr4dw\") pod \"cluster-proxy-proxy-agent-5bcb9464d8-wznlm\" (UID: \"edb3d3c6-2ed6-42fc-852b-8dde57f54fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.662548 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.662488 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" Jul 02 21:20:20.677933 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.677903 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:20.805375 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.805344 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:20.805773 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.805757 2585 scope.go:117] "RemoveContainer" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" Jul 02 21:20:20.805971 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:20.805947 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:20.806031 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.805990 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm"] Jul 02 21:20:20.808460 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:20.808441 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedb3d3c6_2ed6_42fc_852b_8dde57f54fec.slice/crio-b016328f3d2e110152470fa880bac6d2a452c03a5d6e400ef994dc754a0ae7c6 WatchSource:0}: Error finding container b016328f3d2e110152470fa880bac6d2a452c03a5d6e400ef994dc754a0ae7c6: Status 404 returned error can't find the container with id b016328f3d2e110152470fa880bac6d2a452c03a5d6e400ef994dc754a0ae7c6 Jul 02 21:20:20.906235 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:20.906205 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:21.019864 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:21.019778 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:21.135736 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:21.135704 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" event={"ID":"edb3d3c6-2ed6-42fc-852b-8dde57f54fec","Type":"ContainerStarted","Data":"b016328f3d2e110152470fa880bac6d2a452c03a5d6e400ef994dc754a0ae7c6"} Jul 02 21:20:23.039670 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:23.039635 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:23.040129 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:23.040106 2585 scope.go:117] "RemoveContainer" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" Jul 02 21:20:23.040349 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:23.040330 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:25.131937 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.131909 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:25.153646 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.153535 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" event={"ID":"edb3d3c6-2ed6-42fc-852b-8dde57f54fec","Type":"ContainerStarted","Data":"0486f1460eafae40d2e8007cf70f66d78b0afdd925527639e28a6cd3b0c4c990"} Jul 02 21:20:25.153646 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.153597 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" event={"ID":"edb3d3c6-2ed6-42fc-852b-8dde57f54fec","Type":"ContainerStarted","Data":"ad0855e46bfbf1fccdf50eb1e2445d4e2a2815282b0b2a0094bc3a329144c199"} Jul 02 21:20:25.231916 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.231887 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:25.538827 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.538794 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:25.613502 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:25.613467 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:26.159978 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.159944 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" event={"ID":"edb3d3c6-2ed6-42fc-852b-8dde57f54fec","Type":"ContainerStarted","Data":"7f5f2900644df18e1315191a34da4328cc461c9da60edfc3ccd8d72bb8e58ed7"} Jul 02 21:20:26.181669 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.181627 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bcb9464d8-wznlm" podStartSLOduration=1.9596225710000001 podStartE2EDuration="6.181613515s" totalImagesPullingTime="4.221990944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:26.179912913 +0000 UTC m=+138.962283726" watchObservedRunningTime="2026-07-02 21:20:26.181613515 +0000 UTC m=+138.963984328" Jul 02 21:20:26.406587 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.406530 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:26.408746 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.408727 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98e32025-53ea-4903-81d6-64e91bff53b5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kw9lq\" (UID: \"98e32025-53ea-4903-81d6-64e91bff53b5\") " pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:26.424831 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.424773 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zd4gb\"" Jul 02 21:20:26.432452 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.432436 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kw9lq" Jul 02 21:20:26.577105 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:26.577078 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kw9lq"] Jul 02 21:20:26.579252 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:26.579226 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e32025_53ea_4903_81d6_64e91bff53b5.slice/crio-deba19300860a03693ecafb0e3725eff7cd802b08240b6a8e06177dc38ca624e WatchSource:0}: Error finding container deba19300860a03693ecafb0e3725eff7cd802b08240b6a8e06177dc38ca624e: Status 404 returned error can't find the container with id deba19300860a03693ecafb0e3725eff7cd802b08240b6a8e06177dc38ca624e Jul 02 21:20:27.166890 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:27.166810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw9lq" event={"ID":"98e32025-53ea-4903-81d6-64e91bff53b5","Type":"ContainerStarted","Data":"deba19300860a03693ecafb0e3725eff7cd802b08240b6a8e06177dc38ca624e"} Jul 02 21:20:28.258727 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:28.258650 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:28.333392 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:28.333358 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:28.581330 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:28.581296 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:31.180146 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:31.180107 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw9lq" event={"ID":"98e32025-53ea-4903-81d6-64e91bff53b5","Type":"ContainerStarted","Data":"e6cd29b4f71333fd79fbeaf9ba3aea2938339dc6c10bcc0470bf107f994ea60a"} Jul 02 21:20:31.180479 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:31.180164 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw9lq" event={"ID":"98e32025-53ea-4903-81d6-64e91bff53b5","Type":"ContainerStarted","Data":"1a55db53123bcdd0c9c82f9701043ad306d1e49b887043eb6801214de6bcbe87"} Jul 02 21:20:32.164255 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:32.164218 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:32.264547 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:32.264489 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:32.368638 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:32.368607 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:34.193121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.193086 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kw9lq" event={"ID":"98e32025-53ea-4903-81d6-64e91bff53b5","Type":"ContainerStarted","Data":"54437a33ab320eb5e79d1ea58cbcdcab31abd1ec98974183e79793674eaa06a4"} Jul 02 21:20:34.223197 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.223154 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kw9lq" podStartSLOduration=33.2921582 podStartE2EDuration="40.223138872s" totalImagesPullingTime="6.930980672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:19:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:34.222088109 +0000 UTC m=+147.004458921" watchObservedRunningTime="2026-07-02 21:20:34.223138872 +0000 UTC m=+147.005509686" Jul 02 21:20:34.407885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.407852 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:34.680329 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.680289 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:34.704481 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.704448 2585 scope.go:117] "RemoveContainer" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" Jul 02 21:20:34.704676 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:34.704653 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8llqz_openshift-console-operator(9d089307-285b-4f9d-8234-3cf63df3f387)\"" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" podUID="9d089307-285b-4f9d-8234-3cf63df3f387" Jul 02 21:20:34.765305 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.765275 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lvnnm"] Jul 02 21:20:34.767732 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.767710 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.775171 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.775151 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 21:20:34.775426 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.775405 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 21:20:34.775549 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.775511 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 21:20:34.776256 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.776232 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-np8j8\"" Jul 02 21:20:34.776517 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.776502 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 21:20:34.776725 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.776710 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 21:20:34.776888 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.776871 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 21:20:34.812382 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.812353 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:34.878305 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878274 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878471 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878339 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-tls\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878471 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878367 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-wtmp\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878596 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878460 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-textfile\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878596 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878514 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-sys\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878596 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878541 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-metrics-client-ca\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878596 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878565 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwxzh\" (UniqueName: \"kubernetes.io/projected/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-kube-api-access-xwxzh\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-root\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.878785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.878650 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.907442 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.907404 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:34.979114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979114 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979104 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-tls\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979127 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-wtmp\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979159 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-textfile\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979181 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-sys\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-metrics-client-ca\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwxzh\" (UniqueName: \"kubernetes.io/projected/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-kube-api-access-xwxzh\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-root\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979280 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-sys\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979302 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-wtmp\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979356 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979313 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-root\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979763 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979611 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-textfile\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.979817 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.979797 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.980170 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.980148 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-metrics-client-ca\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.981702 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.981684 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.981702 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.981698 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-node-exporter-tls\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:34.987447 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:34.987427 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwxzh\" (UniqueName: \"kubernetes.io/projected/c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7-kube-api-access-xwxzh\") pod \"node-exporter-lvnnm\" (UID: \"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7\") " pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:35.008192 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.008163 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:35.079327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.079301 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lvnnm" Jul 02 21:20:35.096100 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:35.096072 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc950d3b3_78c7_4c6d_b0d3_4b0e6cb7b0b7.slice/crio-5b0afcb91835acb825a1114200eca5d67e4c36908e771b0dbbc8c61afbbbb3b3 WatchSource:0}: Error finding container 5b0afcb91835acb825a1114200eca5d67e4c36908e771b0dbbc8c61afbbbb3b3: Status 404 returned error can't find the container with id 5b0afcb91835acb825a1114200eca5d67e4c36908e771b0dbbc8c61afbbbb3b3 Jul 02 21:20:35.107014 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.106988 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:35.197243 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.197208 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvnnm" event={"ID":"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7","Type":"ContainerStarted","Data":"5b0afcb91835acb825a1114200eca5d67e4c36908e771b0dbbc8c61afbbbb3b3"} Jul 02 21:20:35.309628 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.309601 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:35.699134 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.698971 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:35.870035 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:35.869996 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:36.060485 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:36.060457 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:36.202054 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:36.202026 2585 generic.go:356] "Generic (PLEG): container finished" podID="c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7" containerID="10b984848b0e5229c446cb7f32dee711de4d168c84fb96b3856d2c3ad5a94673" exitCode=0 Jul 02 21:20:36.202406 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:36.202097 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvnnm" event={"ID":"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7","Type":"ContainerDied","Data":"10b984848b0e5229c446cb7f32dee711de4d168c84fb96b3856d2c3ad5a94673"} Jul 02 21:20:36.255724 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:36.255694 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:37.207404 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:37.207369 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvnnm" event={"ID":"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7","Type":"ContainerStarted","Data":"0fdf2a231de0e2ff7742d8aa97a40683e4a5eea52a527f0d9ecd17de027a229e"} Jul 02 21:20:37.207785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:37.207422 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lvnnm" event={"ID":"c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7","Type":"ContainerStarted","Data":"dcb3b05b0c0b90f4cdb91ba277324604d6721002f124d2ef2e7d2abebfe8bfab"} Jul 02 21:20:37.238580 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:37.238522 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lvnnm" podStartSLOduration=2.2956267009999998 podStartE2EDuration="3.238505723s" totalImagesPullingTime="879.293343ms" totalInitContainerRuntime="63.585679ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:37.236864049 +0000 UTC m=+150.019234862" watchObservedRunningTime="2026-07-02 21:20:37.238505723 +0000 UTC m=+150.020876557" Jul 02 21:20:37.809911 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:37.809876 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:37.909954 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:37.909918 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:38.009375 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:38.009334 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:38.248422 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:38.248321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:39.408857 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:39.408802 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:39.714955 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:39.714874 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:40.965466 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:40.965432 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:41.118246 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.118214 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:20:41.120876 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.120854 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.126066 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126039 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 21:20:41.126189 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126075 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 21:20:41.126189 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126142 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 21:20:41.126809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126673 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 21:20:41.126809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126724 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 21:20:41.126809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.126727 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6wsjk\"" Jul 02 21:20:41.127042 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127025 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cur1qdh0c64vl\"" Jul 02 21:20:41.127107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127079 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 21:20:41.127107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127088 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 21:20:41.127107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127107 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 21:20:41.127279 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127046 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 21:20:41.127806 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127443 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 21:20:41.127806 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.127531 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 21:20:41.128418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.128401 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 21:20:41.128684 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.128667 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 21:20:41.131877 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.131852 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 21:20:41.132433 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.132410 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:41.136151 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.136135 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 21:20:41.146223 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.146206 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:20:41.225884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225805 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.225884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225833 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.225884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225849 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.225884 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225892 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsxf\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225931 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.225969 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226007 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226031 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226064 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226101 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226142 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226131 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226153 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226211 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226226 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226248 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226263 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226280 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.226418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.226296 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.276381 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.276358 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:41.327384 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327360 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327521 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327403 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327521 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327435 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327521 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327461 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327593 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327704 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327785 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327811 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327836 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.327894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327868 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsxf\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327922 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327950 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.327985 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328007 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328147 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328061 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328495 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328258 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328555 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328515 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.328841 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.328813 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.329327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.329202 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.329469 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.329310 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.331501 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.331154 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332234 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.331811 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332234 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.331826 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332234 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.331837 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332234 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.331942 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332481 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.332330 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332669 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.332621 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332888 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.332865 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.332915 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.332995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.332951 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.333230 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.333202 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.333230 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.333213 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.333563 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.333543 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.333947 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.333931 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.336646 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.336609 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsxf\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf\") pod \"prometheus-k8s-0\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.377409 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.377383 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:41.430722 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.430685 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:41.569623 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:41.569598 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:20:41.570659 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:41.570628 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32817048_8b70_443f_becf_6b4181571c76.slice/crio-f97224c5ea12d0aab465d89edfa9e468c4dd055fa9ea581a5a5acc3d2a89b88f WatchSource:0}: Error finding container f97224c5ea12d0aab465d89edfa9e468c4dd055fa9ea581a5a5acc3d2a89b88f: Status 404 returned error can't find the container with id f97224c5ea12d0aab465d89edfa9e468c4dd055fa9ea581a5a5acc3d2a89b88f Jul 02 21:20:42.228985 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:42.228942 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"f97224c5ea12d0aab465d89edfa9e468c4dd055fa9ea581a5a5acc3d2a89b88f"} Jul 02 21:20:42.452357 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:42.452327 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c785d95-mc2pt"] Jul 02 21:20:42.452632 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:42.452607 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67c785d95-mc2pt" podUID="1dcdc85c-83a7-4946-90f3-06846857f9a3" Jul 02 21:20:42.577579 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:42.577536 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:42.676371 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:42.676338 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:42.775021 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:42.774982 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:43.233743 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.233709 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" exitCode=0 Jul 02 21:20:43.234179 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.233801 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} Jul 02 21:20:43.234179 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.233845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:20:43.238947 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.238900 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:20:43.342015 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.341982 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342035 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342068 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342086 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342108 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6zmc\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342128 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342187 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342152 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates\") pod \"1dcdc85c-83a7-4946-90f3-06846857f9a3\" (UID: \"1dcdc85c-83a7-4946-90f3-06846857f9a3\") " Jul 02 21:20:43.342591 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342285 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:20:43.342591 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342480 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:20:43.343330 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342741 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-trusted-ca\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.343330 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.342768 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1dcdc85c-83a7-4946-90f3-06846857f9a3-ca-trust-extracted\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.343508 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.343484 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:20:43.344793 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.344767 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:20:43.345058 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.345028 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:20:43.345178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.345126 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:20:43.345239 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.345179 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc" (OuterVolumeSpecName: "kube-api-access-f6zmc") pod "1dcdc85c-83a7-4946-90f3-06846857f9a3" (UID: "1dcdc85c-83a7-4946-90f3-06846857f9a3"). InnerVolumeSpecName "kube-api-access-f6zmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:20:43.443686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.443662 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-bound-sa-token\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.443686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.443685 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-image-registry-private-configuration\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.443686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.443694 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6zmc\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-kube-api-access-f6zmc\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.443887 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.443705 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1dcdc85c-83a7-4946-90f3-06846857f9a3-installation-pull-secrets\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:43.443887 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:43.443714 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-certificates\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:44.236584 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:44.236538 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c785d95-mc2pt" Jul 02 21:20:44.279713 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:44.279677 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c785d95-mc2pt"] Jul 02 21:20:44.283250 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:44.283225 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67c785d95-mc2pt"] Jul 02 21:20:44.451662 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:44.451633 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1dcdc85c-83a7-4946-90f3-06846857f9a3-registry-tls\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:20:45.708787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:45.708747 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dcdc85c-83a7-4946-90f3-06846857f9a3" path="/var/lib/kubelet/pods/1dcdc85c-83a7-4946-90f3-06846857f9a3/volumes" Jul 02 21:20:47.249714 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:47.249673 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} Jul 02 21:20:47.250186 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:47.249760 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} Jul 02 21:20:47.570470 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:47.570429 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:47.647976 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:47.647943 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:47.707100 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:47.707071 2585 scope.go:117] "RemoveContainer" containerID="34372bd8e6e8fbbaa007aa2668b9c9853831970bc15abc44ef08852e45dfc0bb" Jul 02 21:20:48.256266 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.256239 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:20:48.256665 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.256308 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" event={"ID":"9d089307-285b-4f9d-8234-3cf63df3f387","Type":"ContainerStarted","Data":"04af55df5a39ad5fd5d9588f43850f4744eb51b0740b03e9287457a06da3d6de"} Jul 02 21:20:48.256665 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.256605 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:48.261619 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.261594 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-8llqz" Jul 02 21:20:48.319317 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.319280 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:48.471284 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.471241 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:48.593629 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.593585 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:48.745864 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.745830 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:48.801937 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:48.801915 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:49.150705 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.150620 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:49.210676 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.210639 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:49.262365 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.262341 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} Jul 02 21:20:49.262701 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.262445 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} Jul 02 21:20:49.262701 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.262474 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} Jul 02 21:20:49.262701 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.262498 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerStarted","Data":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} Jul 02 21:20:49.298230 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.298022 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.902504592 podStartE2EDuration="8.298001702s" totalImagesPullingTime="6.377355552s" totalInitContainerRuntime="18.141558ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:20:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:49.296134241 +0000 UTC m=+162.078505054" watchObservedRunningTime="2026-07-02 21:20:49.298001702 +0000 UTC m=+162.080372529" Jul 02 21:20:49.524485 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:20:49.524402 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v6cwv" podUID="461a0998-67f1-40bc-b911-cfd6ea3b59a4" Jul 02 21:20:49.962726 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:49.962690 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:50.063496 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:50.063460 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:50.166722 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:50.166688 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:50.265627 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:50.265545 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6cwv" Jul 02 21:20:50.776758 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:50.776718 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:50.877217 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:50.877183 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:51.431363 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:51.431323 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:20:54.133127 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.133093 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:54.236264 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.236230 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:54.330405 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.330372 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:20:54.332581 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.332550 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/461a0998-67f1-40bc-b911-cfd6ea3b59a4-metrics-tls\") pod \"dns-default-v6cwv\" (UID: \"461a0998-67f1-40bc-b911-cfd6ea3b59a4\") " pod="openshift-dns/dns-default-v6cwv" Jul 02 21:20:54.468761 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.468684 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sklqf\"" Jul 02 21:20:54.476790 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.476769 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v6cwv" Jul 02 21:20:54.602178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:54.602150 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v6cwv"] Jul 02 21:20:54.607143 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:20:54.607108 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461a0998_67f1_40bc_b911_cfd6ea3b59a4.slice/crio-e3409d9d394b556504487564fa83b896f3ad34413f8f7dbe793efa938e194205 WatchSource:0}: Error finding container e3409d9d394b556504487564fa83b896f3ad34413f8f7dbe793efa938e194205: Status 404 returned error can't find the container with id e3409d9d394b556504487564fa83b896f3ad34413f8f7dbe793efa938e194205 Jul 02 21:20:55.283802 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:55.283762 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6cwv" event={"ID":"461a0998-67f1-40bc-b911-cfd6ea3b59a4","Type":"ContainerStarted","Data":"e3409d9d394b556504487564fa83b896f3ad34413f8f7dbe793efa938e194205"} Jul 02 21:20:56.786043 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:56.786009 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:20:57.293023 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:57.292992 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6cwv" event={"ID":"461a0998-67f1-40bc-b911-cfd6ea3b59a4","Type":"ContainerStarted","Data":"48d2be28d0b57f88aaf19d6c50373c06b94f736e070f87bab641d635efe4d362"} Jul 02 21:20:57.293228 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:57.293049 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v6cwv" event={"ID":"461a0998-67f1-40bc-b911-cfd6ea3b59a4","Type":"ContainerStarted","Data":"ee917f96d93f697f45dce46ce3374564fc47bde141f59f420adb206d28eb17fb"} Jul 02 21:20:57.293228 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:57.293081 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v6cwv" Jul 02 21:20:57.311791 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:57.311748 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v6cwv" podStartSLOduration=129.392414716 podStartE2EDuration="2m11.311732541s" totalImagesPullingTime="1.919317825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:20:57.31013206 +0000 UTC m=+170.092502883" watchObservedRunningTime="2026-07-02 21:20:57.311732541 +0000 UTC m=+170.094103354" Jul 02 21:20:59.185403 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:20:59.185369 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:02.557449 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:02.557360 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:02.620912 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:02.620885 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:03.190242 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:03.190202 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:03.291656 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:03.291620 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:07.298766 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:07.298730 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v6cwv" Jul 02 21:21:07.398501 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:07.398465 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:07.465081 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:07.465053 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:07.744286 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:07.744211 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:07.811862 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:07.811831 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:11.184261 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:11.184217 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:11.245408 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:11.245383 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:16.430033 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:16.429997 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:16.530550 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:16.530518 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:17.393408 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:17.393365 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:17.455981 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:17.455949 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:17.548113 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:17.548078 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:17.607310 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:17.607268 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:19.172950 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:19.172915 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:19.525103 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:19.525012 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:19.594591 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:19.594539 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:20.220435 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:20.220402 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:20.321450 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:20.321415 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:31.427864 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:31.427831 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:31.528839 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:31.528812 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:31.591144 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:31.591111 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:32.549407 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:32.549375 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:32.650232 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:32.650195 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:41.431911 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:41.431863 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:21:41.450809 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:41.450784 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:21:41.465264 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:41.465242 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:21:50.965516 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:50.965478 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:51.022252 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:51.022215 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:57.616028 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:57.615989 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:58.037757 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:58.037723 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:58.137620 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:58.137588 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:21:59.450308 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450272 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450583 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="prometheus" containerID="cri-o://653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" gracePeriod=600 Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450605 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-thanos" containerID="cri-o://15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" gracePeriod=600 Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450628 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-web" containerID="cri-o://722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" gracePeriod=600 Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450634 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="thanos-sidecar" containerID="cri-o://e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" gracePeriod=600 Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450658 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="config-reloader" containerID="cri-o://f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" gracePeriod=600 Jul 02 21:21:59.450733 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.450696 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy" containerID="cri-o://b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" gracePeriod=600 Jul 02 21:21:59.680885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.680856 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:21:59.806690 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806660 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wsxf\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806702 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806723 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806741 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806759 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806786 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.806847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806811 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806854 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806882 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806911 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806949 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.806980 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807031 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807072 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807069 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.807110 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807104 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807147 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807175 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807200 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807237 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807271 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1\") pod \"32817048-8b70-443f-becf-6b4181571c76\" (UID: \"32817048-8b70-443f-becf-6b4181571c76\") " Jul 02 21:21:59.807559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807483 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-metrics-client-ca\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.807874 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.807816 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.808652 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.808323 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.809473 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.809122 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.809473 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.809229 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.809959 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.809933 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf" (OuterVolumeSpecName: "kube-api-access-6wsxf") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "kube-api-access-6wsxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:21:59.810107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810092 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.810186 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810125 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.810372 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810351 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out" (OuterVolumeSpecName: "config-out") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:21:59.810511 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810465 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.810636 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810617 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.810925 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810880 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config" (OuterVolumeSpecName: "config") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.810925 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.810883 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 21:21:59.811070 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.811030 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:21:59.811203 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.811176 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.811294 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.811272 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.811405 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.811385 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.811883 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.811864 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:21:59.812330 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.812311 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.820299 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.820275 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config" (OuterVolumeSpecName: "web-config") pod "32817048-8b70-443f-becf-6b4181571c76" (UID: "32817048-8b70-443f-becf-6b4181571c76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 21:21:59.908148 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908122 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908148 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908146 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsxf\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-kube-api-access-6wsxf\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908148 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908155 2585 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-grpc-tls\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908164 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908178 2585 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-metrics-client-certs\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908190 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908202 2585 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-config\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908212 2585 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-config-out\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908222 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908230 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908238 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908246 2585 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908254 2585 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-web-config\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908261 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/32817048-8b70-443f-becf-6b4181571c76-prometheus-k8s-db\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908269 2585 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908278 2585 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32817048-8b70-443f-becf-6b4181571c76-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908286 2585 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/32817048-8b70-443f-becf-6b4181571c76-tls-assets\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908294 2585 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:21:59.908352 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:21:59.908302 2585 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/32817048-8b70-443f-becf-6b4181571c76-secret-kube-rbac-proxy\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:22:00.507017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.506985 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" exitCode=0 Jul 02 21:22:00.507017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507008 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" exitCode=0 Jul 02 21:22:00.507017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507016 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" exitCode=0 Jul 02 21:22:00.507017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507021 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" exitCode=0 Jul 02 21:22:00.507017 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507027 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" exitCode=0 Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507032 2585 generic.go:356] "Generic (PLEG): container finished" podID="32817048-8b70-443f-becf-6b4181571c76" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" exitCode=0 Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507072 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507067 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507160 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507203 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507221 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507243 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507283 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507325 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} Jul 02 21:22:00.507787 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.507363 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"32817048-8b70-443f-becf-6b4181571c76","Type":"ContainerDied","Data":"f97224c5ea12d0aab465d89edfa9e468c4dd055fa9ea581a5a5acc3d2a89b88f"} Jul 02 21:22:00.516843 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.516823 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.528071 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.528049 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.534315 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.534295 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:22:00.535449 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.535434 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.538513 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.538492 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:22:00.542023 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.542004 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.548006 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.547994 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.554486 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.554470 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.560528 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.560508 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.560809 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.560788 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.560885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.560820 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.560885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.560865 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.561106 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.561087 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.561145 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561111 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.561145 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561128 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.561337 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.561322 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.561398 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561344 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.561398 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561363 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.561625 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.561604 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.561670 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561633 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.561670 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561654 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.561888 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.561872 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.561925 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561891 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.561925 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.561904 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.562116 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.562096 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.562209 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562118 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.562209 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562130 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.562347 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:22:00.562333 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.562386 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562350 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.562386 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562363 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.562560 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562543 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.562612 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562560 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.562842 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562806 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.562842 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.562835 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.563204 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563173 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.563278 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563206 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.563542 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563508 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.563542 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563532 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.563852 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563808 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.563852 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.563831 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.564090 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564063 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.564090 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564089 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.564334 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564315 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.564385 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564335 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.564501 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564484 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:22:00.564676 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564558 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.564738 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564682 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.564776 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564759 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy" Jul 02 21:22:00.564776 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564772 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564782 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="init-config-reloader" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564788 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="init-config-reloader" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564794 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-thanos" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564799 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-thanos" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564809 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="prometheus" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564814 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="prometheus" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564822 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="thanos-sidecar" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564830 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="thanos-sidecar" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564843 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="config-reloader" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564851 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="config-reloader" Jul 02 21:22:00.564863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564865 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-web" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564874 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-web" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564922 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564943 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.564930 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-thanos" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565011 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="config-reloader" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565020 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="prometheus" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565027 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="thanos-sidecar" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565033 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565044 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="32817048-8b70-443f-becf-6b4181571c76" containerName="kube-rbac-proxy-web" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565188 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.565210 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565204 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.565620 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565426 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.565620 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565449 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.565715 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565691 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.565766 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565715 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.565929 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565912 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.565996 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.565930 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.566168 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566150 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.566221 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566170 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.566379 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566362 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.566422 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566389 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.566617 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566599 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.566665 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566619 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.566828 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566812 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.566872 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.566828 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.567042 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567023 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.567088 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567078 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.567293 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567275 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.567293 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567292 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.567531 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567508 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.567531 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567531 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.567757 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567741 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.567803 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567759 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.567955 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567940 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.567997 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.567955 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.568151 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568131 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.568151 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568151 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.568361 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568343 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.568406 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568361 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.568561 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568544 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.568651 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568563 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.568798 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568780 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.568865 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568799 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.568990 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568974 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.569048 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.568990 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.569178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569162 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.569244 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569180 2585 scope.go:117] "RemoveContainer" containerID="15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84" Jul 02 21:22:00.569419 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569400 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84"} err="failed to get container status \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": rpc error: code = NotFound desc = could not find container \"15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84\": container with ID starting with 15e32f41b1d31582f1ea34d3486fc6e965ad151f0fa445366c19187381508a84 not found: ID does not exist" Jul 02 21:22:00.569465 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569420 2585 scope.go:117] "RemoveContainer" containerID="b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16" Jul 02 21:22:00.569623 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569605 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16"} err="failed to get container status \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": rpc error: code = NotFound desc = could not find container \"b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16\": container with ID starting with b1cd250e30e45d76ba388449508fbfe8a6b51e1ca73b0d1d0aea6f14865bed16 not found: ID does not exist" Jul 02 21:22:00.569737 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569624 2585 scope.go:117] "RemoveContainer" containerID="722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed" Jul 02 21:22:00.569848 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569829 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed"} err="failed to get container status \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": rpc error: code = NotFound desc = could not find container \"722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed\": container with ID starting with 722aea64dd4cc304477bdd444a6f1537ca9a9fc43551a744121960723e4d53ed not found: ID does not exist" Jul 02 21:22:00.569896 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.569851 2585 scope.go:117] "RemoveContainer" containerID="e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a" Jul 02 21:22:00.570061 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570040 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a"} err="failed to get container status \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": rpc error: code = NotFound desc = could not find container \"e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a\": container with ID starting with e30971d3d34ec998b470952aa301734c52168f154b18e0462b93ef20fd57306a not found: ID does not exist" Jul 02 21:22:00.570106 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570062 2585 scope.go:117] "RemoveContainer" containerID="f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65" Jul 02 21:22:00.570201 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570173 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.570278 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570246 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65"} err="failed to get container status \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": rpc error: code = NotFound desc = could not find container \"f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65\": container with ID starting with f3c3be2f53c547b4618da10d5322add8f4d013833e4e7c80a742dcc0cd396c65 not found: ID does not exist" Jul 02 21:22:00.570278 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570263 2585 scope.go:117] "RemoveContainer" containerID="653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba" Jul 02 21:22:00.570508 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570470 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba"} err="failed to get container status \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": rpc error: code = NotFound desc = could not find container \"653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba\": container with ID starting with 653472958aea5661445f3577a84d5519fec7182c86c3187d33c52533954c6aba not found: ID does not exist" Jul 02 21:22:00.570602 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570510 2585 scope.go:117] "RemoveContainer" containerID="eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278" Jul 02 21:22:00.570909 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.570889 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278"} err="failed to get container status \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": rpc error: code = NotFound desc = could not find container \"eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278\": container with ID starting with eeee2a90247d4497c41ce309178e85daf4a96160ad2386e0ab8a1c065fbb4278 not found: ID does not exist" Jul 02 21:22:00.572488 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.572470 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 21:22:00.572549 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.572506 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 21:22:00.573703 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.573687 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 21:22:00.574003 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.573981 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 21:22:00.574074 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574038 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 21:22:00.574241 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574212 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 21:22:00.574241 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574233 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 21:22:00.574402 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574266 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 21:22:00.574402 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574293 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 21:22:00.574402 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574324 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 21:22:00.574402 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574264 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6wsjk\"" Jul 02 21:22:00.574402 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574268 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 21:22:00.574904 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574888 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 21:22:00.574971 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.574931 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 21:22:00.575129 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.575112 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cur1qdh0c64vl\"" Jul 02 21:22:00.577088 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.577054 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 21:22:00.580309 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.580289 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 21:22:00.583892 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.583875 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:22:00.713919 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713828 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.713919 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.713919 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713895 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.713919 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713918 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713941 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.713963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714053 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714097 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714152 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714195 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714166 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714203 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714230 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714254 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6dj\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-kube-api-access-gb6dj\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714292 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714316 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.714523 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.714331 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.814902 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.814875 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.814902 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.814907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.814927 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.814957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.814984 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815053 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815115 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815112 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815142 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815179 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815292 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815315 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815371 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815395 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6dj\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-kube-api-access-gb6dj\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815468 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.815981 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.815740 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.816068 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.816042 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.816700 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.816385 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.817246 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.817218 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.817786 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.817758 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.817942 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.817915 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.818216 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.818191 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.818353 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.818329 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.818682 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.818611 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.818832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.818787 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.819873 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.819826 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820093 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820071 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820188 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820340 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-config\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820647 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820686 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820663 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.820841 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.820702 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.821024 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.821000 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.821652 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.821632 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.824960 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.824938 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6dj\" (UniqueName: \"kubernetes.io/projected/7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7-kube-api-access-gb6dj\") pod \"prometheus-k8s-0\" (UID: \"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:00.880089 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:00.880054 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:01.012636 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:01.012611 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 21:22:01.014525 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:22:01.014497 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef2b713_0f4b_42b0_8dc0_5b01b33ee8f7.slice/crio-ed9033f3969b72f4ea69acf704f4c887e8fba510f13368ae818c48bbda9f8b53 WatchSource:0}: Error finding container ed9033f3969b72f4ea69acf704f4c887e8fba510f13368ae818c48bbda9f8b53: Status 404 returned error can't find the container with id ed9033f3969b72f4ea69acf704f4c887e8fba510f13368ae818c48bbda9f8b53 Jul 02 21:22:01.513260 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:01.513222 2585 generic.go:356] "Generic (PLEG): container finished" podID="7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7" containerID="8b2a95f50e6d817ba53f725c74b8d6a83207d5480f80f6cf70fceecb2206b3f5" exitCode=0 Jul 02 21:22:01.513721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:01.513270 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerDied","Data":"8b2a95f50e6d817ba53f725c74b8d6a83207d5480f80f6cf70fceecb2206b3f5"} Jul 02 21:22:01.513721 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:01.513363 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"ed9033f3969b72f4ea69acf704f4c887e8fba510f13368ae818c48bbda9f8b53"} Jul 02 21:22:01.714603 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:01.714017 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32817048-8b70-443f-becf-6b4181571c76" path="/var/lib/kubelet/pods/32817048-8b70-443f-becf-6b4181571c76/volumes" Jul 02 21:22:02.520747 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520707 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"fcd8a84ee59eb03d7cb54baa1b05fa25bfbc19a5a018355241684f3c7d49c0a3"} Jul 02 21:22:02.521176 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520796 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"e99eb0937a1f1e32bfdf5fce4916e014eaabb0e2c993c37de6887255c8dd14bf"} Jul 02 21:22:02.521176 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520823 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"f5dac54b8de3d7f4eab19dbb900531bd2fdfb5343d3bb0eb2288f546a67d0b14"} Jul 02 21:22:02.521176 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"1a5bc8d24923fd7e265efdd3c2c2af65009a2a67a170aa782c48dbaf70b6f49e"} Jul 02 21:22:02.521176 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520876 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"cd5dfbd0c863b839d856c861586a7abb8c54160265d96fd3eb428d135d796a93"} Jul 02 21:22:02.521176 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.520900 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7","Type":"ContainerStarted","Data":"96f9209e6cdcaea50fdd87106dd3a157f6f1b01401240ee3e6380c6bcd199f1d"} Jul 02 21:22:02.559450 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.559375 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.540603688 podStartE2EDuration="2.559356818s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.75313ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:22:02.557705669 +0000 UTC m=+235.340076479" watchObservedRunningTime="2026-07-02 21:22:02.559356818 +0000 UTC m=+235.341727631" Jul 02 21:22:02.564112 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.564090 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:02.662104 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:02.662076 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:05.880329 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:05.880294 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:22:12.608680 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:12.608640 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:12.663731 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:12.663679 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:12.749207 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:12.749159 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:12.807845 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:12.807814 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:13.346296 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:13.346254 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:23.098300 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:23.098268 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:23.198204 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:23.198174 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:34.910682 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:34.910599 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:22:55.366009 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:22:55.365973 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:00.880423 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:00.880391 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:23:00.895394 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:00.895370 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:23:01.738617 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:01.738591 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 21:23:07.631368 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:07.631336 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:23:07.640178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:07.640153 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:23:07.640669 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:07.640643 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 21:23:34.642790 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:34.642757 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:34.700276 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:34.700233 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:45.800625 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:45.800562 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:45.859640 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:45.859604 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:46.248485 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:46.248397 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:46.348716 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:46.348692 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:23:46.408299 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:23:46.408242 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:08.444111 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:08.443999 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:08.538909 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:08.538881 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:14.356169 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:14.356131 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:15.418514 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:15.418474 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:15.641549 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:15.641515 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:15.717984 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:15.717908 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:15.853786 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:15.853751 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:15.955070 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:15.955036 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:16.196337 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:16.196300 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:16.398995 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:16.398965 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:24:16.498149 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:24:16.498065 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:23.626363 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:23.626324 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:23.725491 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:23.725454 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:23.859668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:23.859619 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:23.955007 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:23.954925 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:24.174663 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:24.174628 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:24.273894 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:24.273824 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:25:24.334553 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:25:24.334515 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:04.544810 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:04.544777 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:04.615348 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:04.615312 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:15.392589 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:15.392534 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:15.493501 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:15.493468 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:15.557306 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:15.557273 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:34.937920 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:34.937879 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:35.023020 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:35.022984 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:35.207188 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:35.207096 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:35.578124 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:35.578090 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:26:35.645945 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:26:35.645911 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:27:46.587296 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:27:46.587263 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:07.653031 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:07.652996 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:28:07.661480 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:07.661458 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:28:11.166880 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:11.166847 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:36.107970 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:36.107938 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:36.849473 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:36.849438 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:51.933107 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:51.933067 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:52.033875 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:52.033843 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:28:53.242160 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:28:53.242125 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:29:03.252961 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:29:03.252904 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:29:03.487716 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:29:03.487669 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:00.030121 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:00.030081 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:01.625174 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:01.625136 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:39.337190 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:39.337154 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:41.035288 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:41.035252 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:58.439139 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:58.439101 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:58.618984 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:58.618952 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:30:58.672837 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:30:58.672809 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:32:33.717218 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:32:33.717185 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:32:33.796954 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:32:33.796925 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:32:33.871547 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:32:33.871519 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:32:53.710816 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:32:53.710787 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:32:53.883561 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:32:53.883524 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:33:07.675660 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:33:07.675589 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:33:07.686559 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:33:07.686534 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:34:29.055791 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:34:29.055754 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:34:29.133848 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:34:29.133820 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:34:29.196562 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:34:29.196516 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:35:03.315422 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:35:03.315385 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:35:31.759049 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:35:31.759008 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:35:31.823956 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:35:31.823921 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:35:43.573321 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:35:43.573288 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:35:43.671473 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:35:43.671445 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:37:39.278785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:37:39.278752 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:37:44.490029 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:37:44.489987 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:37:44.741331 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:37:44.741236 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:38:07.703785 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:38:07.703758 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:38:07.708910 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:38:07.708891 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:38:18.818381 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:38:18.818345 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:39:54.772428 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:39:54.772397 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:39:59.835426 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:39:59.835393 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:39:59.908245 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:39:59.908206 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:40:24.351653 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:40:24.351607 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:41:00.410390 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:41:00.410357 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:42:00.051465 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:42:00.051428 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:42:05.115680 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:42:05.115646 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:42:05.554250 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:42:05.554212 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:43:07.725354 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:43:07.725321 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:43:07.728092 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:43:07.728061 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:44:05.399193 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:05.399157 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:11.147989 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:11.147946 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:11.248062 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:11.248030 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:40.562164 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:40.562126 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:47.253514 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.253481 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwlvz/must-gather-hw2tz"] Jul 02 21:44:47.256517 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.256500 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.258918 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.258898 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kwlvz\"/\"default-dockercfg-5jcb7\"" Jul 02 21:44:47.259494 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.259470 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwlvz\"/\"openshift-service-ca.crt\"" Jul 02 21:44:47.259548 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.259503 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwlvz\"/\"kube-root-ca.crt\"" Jul 02 21:44:47.268124 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.268098 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwlvz/must-gather-hw2tz"] Jul 02 21:44:47.274938 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.274901 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:47.301518 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.301497 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk69k\" (UniqueName: \"kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.301639 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.301531 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.339173 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.339146 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:44:47.402025 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.401987 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk69k\" (UniqueName: \"kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.402025 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.402025 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.402368 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.402352 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.410663 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.410625 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk69k\" (UniqueName: \"kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k\") pod \"must-gather-hw2tz\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.566270 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.566230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:44:47.687922 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.687898 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwlvz/must-gather-hw2tz"] Jul 02 21:44:47.696847 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:47.696823 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 21:44:48.171690 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:48.171638 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" event={"ID":"b195415a-404f-4348-95d6-2c35f9464d51","Type":"ContainerStarted","Data":"36b955b7b26106df9dca77e614548fe55707deb723640228545b06b87d25fb99"} Jul 02 21:44:54.199235 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:54.199199 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" event={"ID":"b195415a-404f-4348-95d6-2c35f9464d51","Type":"ContainerStarted","Data":"77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07"} Jul 02 21:44:54.199235 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:54.199242 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" event={"ID":"b195415a-404f-4348-95d6-2c35f9464d51","Type":"ContainerStarted","Data":"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f"} Jul 02 21:44:54.215560 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:44:54.215513 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" podStartSLOduration=1.4218996019999999 podStartE2EDuration="7.215498591s" totalImagesPullingTime="5.793598989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:54.214039206 +0000 UTC m=+1606.996410019" watchObservedRunningTime="2026-07-02 21:44:54.215498591 +0000 UTC m=+1606.997869404" Jul 02 21:45:11.205351 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:11.205266 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:12.270012 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:12.269982 2585 generic.go:356] "Generic (PLEG): container finished" podID="b195415a-404f-4348-95d6-2c35f9464d51" containerID="8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f" exitCode=0 Jul 02 21:45:12.270370 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:12.270056 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" event={"ID":"b195415a-404f-4348-95d6-2c35f9464d51","Type":"ContainerDied","Data":"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f"} Jul 02 21:45:12.270370 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:12.270364 2585 scope.go:117] "RemoveContainer" containerID="8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f" Jul 02 21:45:13.175049 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:13.175018 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwlvz_must-gather-hw2tz_b195415a-404f-4348-95d6-2c35f9464d51/gather/0.log" Jul 02 21:45:13.581932 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:13.581894 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:13.748678 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:13.748647 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:13.818526 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:13.818499 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:16.439797 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:16.439766 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4bl5k_856de997-a6a6-44c1-9adc-48e93581b453/global-pull-secret-syncer/0.log" Jul 02 21:45:16.601703 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:16.601676 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" Jul 02 21:45:16.716806 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:16.716732 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-1.ec2.internal_8ee7ae6cb4162cf8d32078bd8fdb4ae5/haproxy/0.log" Jul 02 21:45:18.556931 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.556901 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-kwlvz/must-gather-hw2tz"] Jul 02 21:45:18.557384 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.557096 2585 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="copy" containerID="cri-o://77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07" gracePeriod=2 Jul 02 21:45:18.561198 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.561033 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-kwlvz/must-gather-hw2tz"] Jul 02 21:45:18.784023 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.783998 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwlvz_must-gather-hw2tz_b195415a-404f-4348-95d6-2c35f9464d51/copy/0.log" Jul 02 21:45:18.785608 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.785591 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:45:18.787462 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:45:18.787440 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hw2tz\" is forbidden: User \"system:node:ip-10-0-140-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kwlvz\": no relationship found between node 'ip-10-0-140-1.ec2.internal' and this object" podUID="b195415a-404f-4348-95d6-2c35f9464d51" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:45:18.862622 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.862544 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output\") pod \"b195415a-404f-4348-95d6-2c35f9464d51\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " Jul 02 21:45:18.863950 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.863928 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b195415a-404f-4348-95d6-2c35f9464d51" (UID: "b195415a-404f-4348-95d6-2c35f9464d51"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 21:45:18.963307 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.963283 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk69k\" (UniqueName: \"kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k\") pod \"b195415a-404f-4348-95d6-2c35f9464d51\" (UID: \"b195415a-404f-4348-95d6-2c35f9464d51\") " Jul 02 21:45:18.963450 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.963435 2585 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b195415a-404f-4348-95d6-2c35f9464d51-must-gather-output\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:45:18.965231 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:18.965212 2585 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k" (OuterVolumeSpecName: "kube-api-access-lk69k") pod "b195415a-404f-4348-95d6-2c35f9464d51" (UID: "b195415a-404f-4348-95d6-2c35f9464d51"). InnerVolumeSpecName "kube-api-access-lk69k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 21:45:19.064728 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.064699 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk69k\" (UniqueName: \"kubernetes.io/projected/b195415a-404f-4348-95d6-2c35f9464d51-kube-api-access-lk69k\") on node \"ip-10-0-140-1.ec2.internal\" DevicePath \"\"" Jul 02 21:45:19.200193 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.200115 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:19.286357 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.286321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:19.296030 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.296008 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwlvz_must-gather-hw2tz_b195415a-404f-4348-95d6-2c35f9464d51/copy/0.log" Jul 02 21:45:19.296357 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.296339 2585 generic.go:356] "Generic (PLEG): container finished" podID="b195415a-404f-4348-95d6-2c35f9464d51" containerID="77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07" exitCode=143 Jul 02 21:45:19.296418 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.296387 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:45:19.296464 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.296417 2585 scope.go:117] "RemoveContainer" containerID="77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07" Jul 02 21:45:19.298437 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:45:19.298411 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hw2tz\" is forbidden: User \"system:node:ip-10-0-140-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kwlvz\": no relationship found between node 'ip-10-0-140-1.ec2.internal' and this object" podUID="b195415a-404f-4348-95d6-2c35f9464d51" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:45:19.303944 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.303925 2585 scope.go:117] "RemoveContainer" containerID="8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f" Jul 02 21:45:19.306701 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:45:19.306674 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hw2tz\" is forbidden: User \"system:node:ip-10-0-140-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kwlvz\": no relationship found between node 'ip-10-0-140-1.ec2.internal' and this object" podUID="b195415a-404f-4348-95d6-2c35f9464d51" pod="openshift-must-gather-kwlvz/must-gather-hw2tz" Jul 02 21:45:19.314514 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.314490 2585 scope.go:117] "RemoveContainer" containerID="77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07" Jul 02 21:45:19.314768 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:45:19.314749 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07\": container with ID starting with 77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07 not found: ID does not exist" containerID="77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07" Jul 02 21:45:19.314851 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.314782 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07"} err="failed to get container status \"77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07\": rpc error: code = NotFound desc = could not find container \"77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07\": container with ID starting with 77d81d427a5b9b863d41ee241dafe0dc935ee92d5a7cf8ef0a46d312a21cad07 not found: ID does not exist" Jul 02 21:45:19.314851 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.314807 2585 scope.go:117] "RemoveContainer" containerID="8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f" Jul 02 21:45:19.315072 ip-10-0-140-1 kubenswrapper[2585]: E0702 21:45:19.315050 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f\": container with ID starting with 8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f not found: ID does not exist" containerID="8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f" Jul 02 21:45:19.315119 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.315078 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f"} err="failed to get container status \"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f\": rpc error: code = NotFound desc = could not find container \"8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f\": container with ID starting with 8dfae10cde9d811f5524aba39c895360f449bdca357134bdc9f373c8eedb3a6f not found: ID does not exist" Jul 02 21:45:19.708279 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:19.708247 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b195415a-404f-4348-95d6-2c35f9464d51" path="/var/lib/kubelet/pods/b195415a-404f-4348-95d6-2c35f9464d51/volumes" Jul 02 21:45:20.955483 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:20.955459 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvnnm_c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7/node-exporter/0.log" Jul 02 21:45:20.982143 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:20.982121 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvnnm_c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7/kube-rbac-proxy/0.log" Jul 02 21:45:21.007136 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.007114 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lvnnm_c950d3b3-78c7-4c6d-b0d3-4b0e6cb7b0b7/init-textfile/0.log" Jul 02 21:45:21.152339 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.152313 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/prometheus/0.log" Jul 02 21:45:21.174669 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.174647 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/config-reloader/0.log" Jul 02 21:45:21.206661 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.206609 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/thanos-sidecar/0.log" Jul 02 21:45:21.279905 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.279886 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/kube-rbac-proxy-web/0.log" Jul 02 21:45:21.311759 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.311742 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/kube-rbac-proxy/0.log" Jul 02 21:45:21.338738 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.338708 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/kube-rbac-proxy-thanos/0.log" Jul 02 21:45:21.371419 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:21.371397 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef2b713-0f4b-42b0-8dc0-5b01b33ee8f7/init-config-reloader/0.log" Jul 02 21:45:23.645503 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:23.645461 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/2.log" Jul 02 21:45:23.652682 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:23.652661 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8llqz_9d089307-285b-4f9d-8234-3cf63df3f387/console-operator/3.log" Jul 02 21:45:24.682637 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:24.682604 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-8gr8x_f666eb2f-559c-4ea5-a2eb-fdd68ed888a9/volume-data-source-validator/0.log" Jul 02 21:45:25.641219 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.641194 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6cwv_461a0998-67f1-40bc-b911-cfd6ea3b59a4/dns/0.log" Jul 02 21:45:25.647508 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647485 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6"] Jul 02 21:45:25.647747 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647735 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="copy" Jul 02 21:45:25.647792 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647749 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="copy" Jul 02 21:45:25.647792 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647762 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="gather" Jul 02 21:45:25.647792 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647769 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="gather" Jul 02 21:45:25.647882 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647809 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="gather" Jul 02 21:45:25.647882 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.647818 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b195415a-404f-4348-95d6-2c35f9464d51" containerName="copy" Jul 02 21:45:25.651461 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.651442 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.653885 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.653867 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2hh8\"/\"kube-root-ca.crt\"" Jul 02 21:45:25.654617 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.654599 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2hh8\"/\"openshift-service-ca.crt\"" Jul 02 21:45:25.654707 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.654616 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2hh8\"/\"default-dockercfg-fjmss\"" Jul 02 21:45:25.661073 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.661054 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6"] Jul 02 21:45:25.673754 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.673736 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v6cwv_461a0998-67f1-40bc-b911-cfd6ea3b59a4/kube-rbac-proxy/0.log" Jul 02 21:45:25.800347 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.800327 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nh5kn_1c93a01a-5785-4859-b6d4-90c8c5f07a69/dns-node-resolver/0.log" Jul 02 21:45:25.819049 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.819016 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-sys\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.819157 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.819059 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-lib-modules\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.819157 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.819102 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-proc\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.819157 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.819125 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-podres\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.819255 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.819216 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76d45\" (UniqueName: \"kubernetes.io/projected/e95d4490-1c29-468c-899d-56981b1d178c-kube-api-access-76d45\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920419 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920352 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76d45\" (UniqueName: \"kubernetes.io/projected/e95d4490-1c29-468c-899d-56981b1d178c-kube-api-access-76d45\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920419 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920387 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-sys\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-lib-modules\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-proc\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920479 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-podres\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920483 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-sys\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920555 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-proc\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920614 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920603 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-lib-modules\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.920832 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.920621 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e95d4490-1c29-468c-899d-56981b1d178c-podres\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.927648 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.927630 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76d45\" (UniqueName: \"kubernetes.io/projected/e95d4490-1c29-468c-899d-56981b1d178c-kube-api-access-76d45\") pod \"perf-node-gather-daemonset-xlkq6\" (UID: \"e95d4490-1c29-468c-899d-56981b1d178c\") " pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:25.961620 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:25.961598 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:26.082815 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.082778 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6"] Jul 02 21:45:26.089028 ip-10-0-140-1 kubenswrapper[2585]: W0702 21:45:26.088994 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode95d4490_1c29_468c_899d_56981b1d178c.slice/crio-9eb4a37a64e23f6f85951125ca7c76e558487c2c3000145d54289b09622f9548 WatchSource:0}: Error finding container 9eb4a37a64e23f6f85951125ca7c76e558487c2c3000145d54289b09622f9548: Status 404 returned error can't find the container with id 9eb4a37a64e23f6f85951125ca7c76e558487c2c3000145d54289b09622f9548 Jul 02 21:45:26.321699 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.321663 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" event={"ID":"e95d4490-1c29-468c-899d-56981b1d178c","Type":"ContainerStarted","Data":"37a3bcfe76cd302afffb36e1d01d802d5586dbcb36200fc5e085c95583cb8d62"} Jul 02 21:45:26.321863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.321717 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" event={"ID":"e95d4490-1c29-468c-899d-56981b1d178c","Type":"ContainerStarted","Data":"9eb4a37a64e23f6f85951125ca7c76e558487c2c3000145d54289b09622f9548"} Jul 02 21:45:26.321863 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.321803 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:26.351808 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.351764 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" podStartSLOduration=1.351750396 podStartE2EDuration="1.351750396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:26.35013939 +0000 UTC m=+1639.132510200" watchObservedRunningTime="2026-07-02 21:45:26.351750396 +0000 UTC m=+1639.134121209" Jul 02 21:45:26.462374 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:26.462348 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lq79g_72bc5134-5e61-4304-a9b4-044233245391/node-ca/0.log" Jul 02 21:45:27.687461 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:27.687429 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcfln_07af551a-b4e0-4399-9cab-dced5e118ab8/serve-healthcheck-canary/0.log" Jul 02 21:45:28.371956 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:28.371931 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw9lq_98e32025-53ea-4903-81d6-64e91bff53b5/kube-rbac-proxy/0.log" Jul 02 21:45:28.393327 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:28.393304 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw9lq_98e32025-53ea-4903-81d6-64e91bff53b5/exporter/0.log" Jul 02 21:45:28.414799 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:28.414781 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kw9lq_98e32025-53ea-4903-81d6-64e91bff53b5/extractor/0.log" Jul 02 21:45:32.335438 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:32.335413 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2hh8/perf-node-gather-daemonset-xlkq6" Jul 02 21:45:36.539613 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.539585 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/kube-multus-additional-cni-plugins/0.log" Jul 02 21:45:36.561205 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.561184 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/egress-router-binary-copy/0.log" Jul 02 21:45:36.582866 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.582844 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/cni-plugins/0.log" Jul 02 21:45:36.603816 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.603797 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/bond-cni-plugin/0.log" Jul 02 21:45:36.625985 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.625966 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/routeoverride-cni/0.log" Jul 02 21:45:36.647104 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.647082 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/whereabouts-cni-bincopy/0.log" Jul 02 21:45:36.667666 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.667648 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z5hhs_f491b574-ab3f-467d-9344-ea16d3eb7abb/whereabouts-cni/0.log" Jul 02 21:45:36.725959 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.725939 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ncsks_3a19cac1-c7d7-4ba1-8137-cdd4f70dfdd8/kube-multus/0.log" Jul 02 21:45:36.872440 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.872360 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z6f2h_eeebab5a-bc8c-49c2-9bbe-95337a177513/network-metrics-daemon/0.log" Jul 02 21:45:36.893298 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:36.893259 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z6f2h_eeebab5a-bc8c-49c2-9bbe-95337a177513/kube-rbac-proxy/0.log" Jul 02 21:45:37.603976 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.603940 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:37.882459 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.882380 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/ovn-controller/0.log" Jul 02 21:45:37.900276 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.900251 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/ovn-acl-logging/0.log" Jul 02 21:45:37.926617 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.926592 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/kube-rbac-proxy-node/0.log" Jul 02 21:45:37.948407 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.948384 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 21:45:37.967668 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.967649 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/northd/0.log" Jul 02 21:45:37.989616 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:37.989600 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/nbdb/0.log" Jul 02 21:45:38.013274 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:38.013255 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/sbdb/0.log" Jul 02 21:45:38.070793 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:38.070770 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jhw2p_a6517864-7395-4408-8cb1-d6387db8bbc3/ovnkube-controller/0.log" Jul 02 21:45:38.704542 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:38.704506 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hprp4_04e1781a-08a8-4f8b-b463-ea461015b06e/konnectivity-agent/0.log" limit=1024 Jul 02 21:45:39.248105 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:39.248063 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-zt5xg_2b34acaa-8cc3-48fe-a8af-3a3229d83778/check-endpoints/0.log" Jul 02 21:45:39.296749 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:39.296725 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fjbmt_b24790c8-637a-4c87-a4f0-baa145f8d751/network-check-target-container/0.log" Jul 02 21:45:40.309367 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:40.309338 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hx58k_4fcae706-c6b0-4bdf-9dc2-286c3bab7dba/iptables-alerter/0.log" Jul 02 21:45:40.943178 ip-10-0-140-1 kubenswrapper[2585]: I0702 21:45:40.943148 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gh97c_20a8b808-85ea-4dd0-916e-04fde4d5f61e/tuned/0.log"